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EFFECTS ON CLASSMATES OF A DEVIANT STUDENT’S 
POWER AND RESPONSE TO A TEACHER-EXERTED 
CONTROL TECHNIQUE’ 


WILLIAM J. GNAGEY 
Manchester College 


The purpose of this study was to further 
clarify some of the dynamics of discipline 
in the public school classroom. We were 
especially interested in the reaction of 
a misbehaving student (deviant) to a 
teacher-exerted control technique with re- 
spect to its effect upon the behavior of his 
onlooking nontarget classmates (audience). 
In addition, we wished to determine the in- 
fluence of the deviant’s status in the class 
power structure. 

Two notable efforts in the area of dis- 
cipline research have been concerned pri- 
marily with the effects of certain types of 
control efforts upon the deviant himself. 
Redl and Wineman (1951, 1952) pioneered 
in this field, reporting the results of a clini- 
cal study of ego damaged children. More 
recently Kounin and Gump (1958) pub- 
lished preliminary findings of a somewhat 
different nature. They were able to show 
that a teacher’s control effort not only in- 
fluences the behavior of the deviant who 


* The present paper represents a portion of 
the dissertation presented in partial fulfill- 
ment of the requirements for the degree of 
doctor of philosophy at Wayne State Uni- 
versity, 1959. The writer wishes to express his 
thanks to the members of the Education Re- 
search Project of Wayne State University: 
Jacob 8. Kounin (doctoral committee chair- 
man), Paul V. Gump, and James J. Ryan. 
Financial support for the project, of which 
this is a part, has been provided by the Na- 
tional Institute of Mental Health, National 
Institutes of Health, Public Health Service, 
Grant M-1066. 


is its target, but significantly affects the 
behavior of students who are audience to 
but not targets of the disciplinary action. 
This phenomenon was called the ripple 
effect. 

One of the factors influencing the ripple 
effect interested us especially. Kounin and 
Gump discovered that children who were 
connected in some way with the deviant or 
deviancy before the control technique was 
emitted appeared to have been more in- 
fluenced than those who had no such pre- 
vious connection. This raised the question 
as to what the nature of some of these pre- 
vious connections might be, other than 
those of attention or proximity at the time 
of the deviancy. We believed one might be 
social power status. 

The impact of a powerful group mem- 
ber’s behavior upon the other members of 
the group had previously been studied by 
Lippitt, Polansky, and Redl (1952) in two 
camp settings. They concluded that the be- 
havior of a boy was more likely to spread 
to other members of the group when he had 
high power than when he had low power. 
The Lippitt group limited their study of 
contagion to overt behavior. We were in- 
terested in the possibility that the overt 
reaction of the deviant to the control tech- 
nique might influence the perceptual be- 
havior of the nontarget audience, as well as 
their overt actions, and possibly also their 


learning. 
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THEORETICAL EXPECTATIONS 


Power of the Teacher 


Since the Lippitt group found that male 
members tended to identify more with a 
high influence peer than with a low in- 
fluence peer, we believed that if a high- 
powered deviant submitted to the teacher’s 
control effort, his overt acceptance of the 
teacher’s dominance would spread to the 
others in the class for whom the deviant 
was an identifying figure. Likewise, we pre- 
dicted that a high-powered deviant’s atti- 
tude of defiance toward the teacher would 
also spread to his classmates. 

The responses of opposite sex members 
of the class were not clearly predictable. 
Even if girls should agree with the boys in 
attributing high power to a certain male 
deviant, it is doubtful if the identification 
dynamic would be of the same nature. 

Though we expected little contagion 
from the behavior of the low-powered de- 
viant, we entertained the possibility that 
the mere success or failure of the teacher 
to achieve submission from him might be 
used as a cue by the audience upon which 
they might base their judgements on the 
teacher’s ability to control the class. 


Valence of the Teacher 


French (1956) suggests that there are 
several “bases of power” when considering 
the influence of a leader over a group. 
These are: attraction, coercion, expertness, 
reward, and legitimacy. We hypothesized 
that any incident which influenced the total 
power attributed to the teacher by her 
class might influence their judgement of her 
power from each of these bases. In other 
words, we predicted that if the deviant’s 
response tended to cause the audience to 
raise their appraisal of the teacher’s ability 
to handle the class (i.e., themselves), it 
might also raise the level of her attractive- 
ness to the group. 


Expertness of the Teacher 


Following a line of reasoning parallel to 
that in the paragraph above, we predicted 


that whatever the experimental incident 
did to the audience judgement of the 
teacher’s ability to handle the class, this 
would also be reflected in their judgement 
of her expertness, another of French’s bases 
of social power. 


Fairness of the Control Technique 


We anticipated a ripple effect concern- 
ing the apparent fairness of the control 
technique. The attitude of acceptance (sub- 
mission) or rejection (defiance), conveyed 
to the audience by means of the deviant’s 
overt response to the control technique, 
would be spread to others in the audience 
for whom the deviant was an identifying 
figure. We believed the effects of the low- 
powered deviant’s response would be neg- 
ligible, but were uncertain about the re- 
sponses of members of opposite sex. 


Differences in Audience Learning 


In appraising defiance and submission as 
two responses which a deviant might act 
out, we believed that the former behavior 
was unusual enough so that the general ex- 
pectation of the audience—that a student 
will do what a teacher tells him to—would 
be disrupted. If this happened, we believed 
an imbalance tension would result, cutting 
down the efficiency of recall in the audience. 
Heider (1946) has discussed balance in 
some detail. 

In addition, we believed that the audi- 
ence would be in a greater state of tension 
if the defiant class member had high power, 
since a greater sensitivity to his actions 
would be present in those for whom he was 
an identifying figure. 


Tue EXPERIMENTAL PROCEDURE 


We accordingly devised an experimental — 
design in which the independent variables — 


were (a) the response of the deviant (de- 
fiance vs. submission) and (b) the power 
of the deviant (high power vs. low power). 
As discussed above, the dependent variables 
were: (a) power of the teacher, (b) valence 
of the teacher, (c) expertness of the 
teacher, (d) fairness of the control tech- 
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nique (as qualitative characteristics of the 
audience perceptual behavior), and (e) au- 
dience learning. In brief, four classes of 
fifth graders were to be measured before 
and after the showing of a 10-minute film 
during which a male classmate, selected 
and trained secretly beforehand, misbe- 
haved, became the target of a control 
technique executed by a new teacher, and 
reacted in a prearranged defiant or sub- 
missive manner. 


Subjects 


Four classes of fifth graders (V = 130) 
were chosen from schools in the area 
around North Manchester, Indiana. Since 
it was our purpose to obtain “classroom 
reality,” we chose intact homerooms which 
had operated as such from September of 
1956 until May of 1957. We felt that the 
group structure would be more stabilized 
by the end of the school year than at the 
beginning. Table 1 summarizes the size, sex 
composition, and ability of each group. It 
was established that none of the differences 
existing among the average achievement of 
the groups favored the experimental hy- 
potheses. 


Pre-experimental Measurements 


The experimenter administered the first 
questionnaire under the guise of one who 
was making a study of “how to make school 
more interesting.” The students were pro- 
vided with a list of their classmates’ names, 
since part of the instrument was a socio- 
gram constructed to measure the social 
power attributed to each boy by other 
members of his class. Such items as the 
following were used: 


When a bunch of kids from this class get 
together outside of school, which three boys 
nearly always get the others to do what they 
want to? 

Some boys are stronger and tougher than 
others. If it came to a fight, which three boys 
in this class could win over most of the rest, 
if they had to? 


A second section measured the students’ 
pre-experimental perceptions of the power, 


TABLE 1 


SEVERAL CHARACTERISTICS OF THE 
EXPERIMENTAL GROUPS 


Mean 
Aca- 
demic 
Boys | Girls | Total | Grade* 


Number of Subjects 


Group 


High-powered de- | 19 | 18 | 37 | 3.8 
fiant 
High-powered 12 | 13 | 25 | 3.9 
submissive 
Low-powered defi- | 18 | 15 | 33 | 3.5 
ant 
Low-powered sub- | 13 | 22 | 35 | 3.2 
missive 


® Mean academic grade was computed by averaging 
the grades for all subjects (except art and music) for the 
preceding grading period. A five-point scale was used: 
A-5, B-4, C-3, D-2, F-1. 


expertness, and valence of female teachers 
in general. Such questions as the following 
were used: 


How well can lady teachers handle the 
kids in this class? 

How much do lady teachers know about 
showing films? 

How well do you like most lady teachers? 


Students registered each of their an- 
swers by drawing a vertical line across a 
100 centimeter horizontal rating scale 
which had the extreme choices printed at 
the ends. Scores were ascertained by meas- 
uring the number of centimeters between 
the students’ mark and the negative end of 
the scale. 


Selection and Training of Deviants 


On a subsequent day, the experimenter 
and T (a female elementary education 
major) secretly trained the boy who had 
been selected by means of the sociogram. 
In each of two classes a high-powered boy 
was chosen, and in the other two, low- 
powered boys were selected. Table 2 sum- 
marizes the attributed power ratio of each 
of the boys finally chosen. Other questions 
helped us avoid choosing deviants who 
were actively disliked. Each of these boys 
was secretly trained to play a specific part 
during the experimental situation in his 
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TABLE 2 


ATTRIBUTED PoweER RatTios OF 
DEVIANTS BY GROUPS 


Attributed Power Ratios* 


G 
Girls’ Boys’ Combined 


Ratings Ratings Ratings 


High-powered defi- .82 .68 
ant 

High-powered sub- .70 .75 
missive 

Low-powered defiant .16 .03 
Low-powered sub- .01 -03 
missive 


-09 
-02 


* Attributed power ratio computed by dividing ac- 
tual number of power choices received, by most possible. 


own group. By means of role-play tech- 
niques, they were trained to execute the 
same deviancy (saying aloud, “Hey, is 
this film about over?”) in each group. 
Two of the deviants were trained to re- 
act to the control technique in a submis- 
sive manner (hanging the head and saying, 
“Yes ma’am, I’m sorry ma’am,” as each 
left the room). The other deviants were 
trained to react in a defiant manner (say- 
ing belligerently, “I'll leave the room, but 
I won’t go to the principal’s office. The 
heck with you!” as he left the room). 


The Experimental Episode 


Some time after the newly trained de- 
viant had returned to his room, the ex- 
perimenter appeared officially. After the 
class had been seated in the projection 
room, the experimenter introduced the 
teacher by saying, “Yesterday I told you 
I would bring along a grade-school teacher 
who would show you a film. This is Miss 
Robe. She wants to talk to you about the 
film before she shows it, so I will turn the 
class over to her.” At this, the experi- 
menter left the room. 

The teacher then said to the class, “I 
am very interested in finding out some 
things about films that we show in school. 
I have brought one with me today. I want 
you to watch it quietly, without talking, so 
that you can rate it accurately when it is 


over.” She then turned out the light and 
began showing the film. 

At a prearranged signal (the teacher 
scratched her head), the deviant talked 
aloud in the prescribed manner. The 
teacher immediately shut off the pro- 
jector and said in an irritated voice, “Hey 
you, I told you not to talk. You leave 
the room and report to the principal’s 
office.” The deviant then reacted to this 
control technique in his prescribed defiant 
or submissive manner and left the room. 
The teacher then showed the rest of the 
film, turned on the light and left the room. 


Postexperimental Measurements 


Shortly, the experimenter re-entered the 
room and passed out the final question- 
naire which ostensibly rated the film show- 
ing, but which also measured the de- 
pendent variables. The first part was a 
rating scale containing questions matched 
to those on the first instrument. These 
indicated the change in the dependent 
variables. The second section of the final 
measurement was an objective, multiple- 
choice test over many of the facts pre- 
sented in the film. Some typical items 
were: “How many boys were working in 
the laboratory? (one, two, three, four, 
five).” “At the end of the film, the boy 
who held the microscope had: (black hair, 
red hair, blonde hair, brown hair, white 
hair).” Scores were ascertained by com- 
puting the number of correct responses. 

Finally, a fairness question was added. 
It read: “How fair is it for the teacher 
to send a person to the principal’s office 
for talking during a film?” The horizontal 
rating scale technique was used in this 
item. 

Thus the effects of four separate con- 
ditions were measured, each one a unique 
combination of the social power and overt 
reaction of the deviant, that is, high- 
powered and defiant, high-powered and 
submissive, low-powered and defiant, low- 
powered and submissive. The deviancy, 
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the control technique, the film, and the 
teacher were all constants in the situation. 


RESULTS AND DiscussION 


With the exception of the questions 
that measured fairness and learning, scores 
on all items were derived from the dif- 
ferences between the matched items on 
the first and second measurements. These 
change scores were prefixed with a plus or 
minus sign to indicate the direction in 
which the subject’s answer varied, and 
where treated by the chi square test. 

Due to an artifact of the measuring de- 
vice, some of the scores on the premeasure- 
ment were seriously restricted from any 
possibility of shift. We therefore checked 
back on each apparently significant result 
to make sure that these frozen scores did 
not work against the null hypothesis. In 
cases where they favored the experimental 
hypotheses, Fisher exact probability test 
was used. 


Power Ascribed to the Teacher 


The students of each class were asked to 
rate how well they thought the teacher 
“could handle the kids in their class.” 
Students (boys and girls combined) who 
saw deviants submit to the teacher’s con- 
trol effort rated her as significantly more 
capable of handling kids in their class than 
did students who saw deviants defy her 
(x* = 16.55, p <.001) (see Table 3). 


In order to determine whether the power 
of the deviant influenced the effects on 
the audience, two other comparisons were 
completed. Because of the aforementioned 
possibility of an identification linked con- 
tagion effect, we compared male high- 
powered defiance scores with male high- 
powered submissive scores and found that 
boys who saw a high-powered deviant sub- 
mit thought the teacher could handle the 
kids in the class significantly better than 
did boys who saw a high-powered deviant 
defy (p = .0096, Fisher exact test) (see 
Table 3). 

When a similar comparison was made 
between low-powered defiant and low- 
powered submissive scores, the difference 
was just below the .05 level of confidence 
(p = .0524, Fisher exact test) ‘see Table 
3). 

When male and female scores were 
lumped together, the high-powered de- 
fiant vs. the high-powered submissive and 
the low-powered defiant vs. the low-pow- 
ered submissive comparisons were both 
well above the .01 level of confidence. 

This might indicate that while all on- 
lookers used the deviant’s reaction as a 
cue to the teacher’s success as a discipli- 
narian, boys were somewhat more sensi- 
tive to the cues emitted by the high- 
powered deviants than those emitted by 
the low-powered deviants. 


TABLE 3 


EFFECTS OF THE DEvVIANT’s REACTION UPON His CLASSMATES’ PERCEPTION 
OF THE TEACHER’S POWER 


Scores 
Subjects Groups x? (1 df) 

All All Defiant 40 31 

All Submissive 54 6 16.55 <.001 
Male Only High-powered defiant ll 8 

High-powered submiss. 12 0 -0095* 
Male Only Low-powered defiant li 12 

Low-powered submiss. 12 1 .0524* 


® Fisher exact probability. 
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Valence of the Teacher 


Students were asked to indicate how 
much they liked the teacher. When male 
and female scores were lumped together, 
no significant difference was apparent be- 
tween students who saw the deviant sub- 
mit and those who saw deviants defy the 
teacher. No other comparisons produced 
significant differences. 


Expertness of the Teacher 


The students were asked to indicate how 
much they thought the teacher knew about 
showing films. Students (boys and girls 
combined) who saw deviants submit to 
the teacher’s control effort rated her as 
knowing more about showing films than 
did students who saw deviants defy her 
(x° = 7.07, p <.01) (see Table 4). 

It was found that students who saw 
high-powered deviants submit rated the 
teacher as more expert than did students 
who saw high-powered deviants defy (x* = 
14.10, p <.001). A similar comparison 
done with those who saw low-powered 
deviants submit showed no significant dif- 
ference (x* = .007, p >.95) (see Table 4). 

This would tend to support the hypothe- 
sis that factors which influence the teach- 
er’s total ascribed power tend to influence 
audience perception of her expertness also. 
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In addition, it would appear that students 
are more sensitive to cues emitted by high- 
powered deviants than those by low-pow- 
ered deviants. 


Fairness of the Control Technique 


The students were asked to indicate how 
fair they thought it was for a teacher to 
send a person to the principal’s office. 
Those (boys and girls combined) who saw 
deviants submit to the teacher’s control 
effort rated the control technique as sig- 
nificantly fairer than did those who saw 
deviants defy (x* = 8.96, p <.01) (see 
Table 5). 

In addition, while students who saw a 
high-powered deviant submit rated the 
control technique as fairer than did stu- 
dents who saw a high-powered deviant defy 
(x? = 11.09, p <.001), no significant dif- 
ference was found between students who 
saw a low-powered deviant submit and 
those who saw a low-powered deviant defy 
(x* = .09, p >.80) (see Table 5). 

This would tend to support the hypothe- 
sis that the deviant’s attitude tended to 
spread to his classmates and that the ef- 
fects were much stronger when he was 
high-powered than when he had low- 
power. 


TABLE 4 


EFFEcTs OF THE DeviaNt’s REACTION UPON His CLassMATES’ PERCEPTION 
OF THE TEACHER’S EXPERTNESS 


Subjects G — id 
ubjec roups x? (1 df) 
All Defiant 40 30 
Submissive 46 12 
7.07 <.01 
All High-powered defiant 18 19 
High-powered submiss. 22 1 
14.10 <.001 
All Low-powered defiant 22 ll 
Low-powered submiss. 23 12 
.007 >.95 
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Audience Learning Scores 


Scores from the multiple-choice test 
were used to measure the students’ recog- 
nition of film facts. Students (boys and 
girls combined) who saw deviants defy the 
teacher were able to recognize significantly 
fewer film facts than were students who 
saw deviants submit to the teacher’s con- 
trol effort (¢ = 2.07, df = 129, p <.05) 
(see Table 6). 

In addition, while the boys who saw 


high-powered deviants submit were able 
to recognize significantly more film facts 
than were boys who saw high-powered 
deviants defy (t = 2.08, df = 30, p <.05), 
no difference was found between boys who 
saw low-powered deviants submit and boys 
who saw low-powered deviants defy (t = 
1.14, df = 30, p >.10) (see Table 6). 

This would tend to support the hypothe- 
sis that a deviant’s defiance of a teacher 
caused enough disruption of the expecta- 


TABLE 5 


EFFEcTs OF THE DEvIANT’s REACTION UPON His CLASSMATES’ PERCEPTION OF THE 
FAIRNESS OF THE CONTROL TECHNIQUE 


Subjects Gro; 

ubjec ups x? (1 df) 
All Defiant 49 19 
Submissive 49 3 

8.96 <.01 
All High-powered defiant 19 16 
High-powered submiss. 23 1 

11.09 <.001 

All Low-powered defiant 30 3 
Low-powered submiss. 26 2 

09 >.80 

TABLE 6 


Errects OF THE Dreviant’s REACTION UPON His CLassMATES’ LEARNING 
or Fitm Facts 


Subjects Group N Mean Score* 
All Defiant 70 3.76 .471 
Submiss. 60 4.10 1.31 
2.07 <.05 
Male Only Hi-pow. 
Defiant 19 3.68 .784 
Hi-pow. 
Submiss. 12 4.50 1.364 
2.08 <.05 
Male Only Low-pow. 
Defiant 18 4.00 .796 
Low-pow. 
Submiss. 13 4.46 1.603 
1.14 >.10 


* Mean score is average number of items marked correctly on film fact test. 
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tions of the other students that they were 
able to learn fewer facts from the film 
than those who saw deviants submit. As 
predicted, this effect appeared to be more 
pronounced on the male classmates when 
the deviants had high power than when 
deviants had low power. 


SUMMARY AND CONCLUSIONS 


Four classes of fifth-graders were shown 
a science film during which a male class- 
mate misbehaved and became the target 
of a control technique exerted by a new 
teacher. The deviants (who were confeder- 
ates of the experimenter) were selected on 
the basis of having high or low power 
among their peers and were trained to re- 
act in either a defiant or submissive man- 
ner. Classmates who saw deviants submit 
to a teacher’s control technique perceived 
the teacher to be more expert and power- 
ful, perceived the control technique to be 
fairer, and recognized more film facts than 
did classmates who saw deviants defy. 
These effects were more pronounced when 


deviants had high power than when they 
had low power. 

It seems reasonable to conclude that 
the overt reaction of a male deviant stu- 
dent does have some measurable effects on 
the perceptual behavior and learning per- 
formances of his classmates and that these 
effects are influenced by the social power 
of the deviant. 


REFERENCES 


Frencu, J. R. P., Jn. A formal theory of 
social power. Psychol. Rev., 1956, 63, 
181-194. 

Heer, F. Attitudes and cognitive organiza- 

tion. J. Psychol., 1946, 21, 107-112. 

Kovuntn, J., & Gump, P. The ripple effect in 
discipline. Elem. sch. J., 1958, 59, 158- 
162. 

Lippitt, R., Potansxy, N., Repu, F., & 
Rosen, S. The dynamics of power. Hu- 
man Relat., 1952, 5, 37-64. 

Rent, F., & Wrneman, D. Children who hate. 
Glencoe, Ill.: Free Press, 1951. 

Rept, F.. & Wrveman, D. Controls from 
within. Glencoe, Ill.: Free Press, 1952. 


(Received August 3, 1959) 


4 
Jou: 
Vol. 
I 
re 
dire 
stuc 
stuc 
not 
ofte 
stru 
late 
| shor 
in n 
cont 
simt 
stud 
: > clas: 
T 
TV 
as 
thou 
teley 
hill: 
1957 
port 
: (195 
inst1 
tion: 
Al 
of ec 
port 

imm 
4 iable 
been 
in tl 
cour: 
ance 
grent 
for tl 


Journal of Educational Psychology 
Vol. 51, No. 1, 1960 


RETENTION OF SUBJECT MATTER AS A FUNCTION 
OF LARGE GROUP INSTRUCTIONAL PROCEDURES: 


LAURENCE SIEGEL, JAMES F. ADAMS; anp F. G. MACOMBER 
Miami University 


Considerable research activity has been 
directed, during the past several years, to 
studies of the comparative achievement of 
students in televised classes, large (but 
not televised) classes, and smaller classes 
often designated as “conventional” in- 
struction. Such research has been stimu- 
lated by the projected increases in college 
enrollments combined with an anticipated 
shortage of well qualified college teachers 
in many subject areas. Within this general 
context, closed circuit instructional tele- 
vision is regarded as potentially useful for 
simultaneously teaching large groups of 
students while overcoming some of the 
visual difficulties inherent in direct large 
class instruction. 

The findings thus far reported for tele- 
vised instruction indicate that students in 
TV classes tend to achieve about as well 
as those in conventional small classes, al- 
though they tend to prefer conventional to 
televised instruction (Carpenter & Green- 
hill: 1955, 1958; Macomber & Siegel: 1956, 
1957). The same findings have been re- 
ported by Siegel, Macomber, and Adams 
(1959) when large group (not televised) 
instruction was compared with conven- 
tional instruction. 

An outstanding feature of the studies 
of comparative achievement heretofore re- 
ported is that they have used a measure of 
immediate retention as the dependent var- 
iable. This measure has, in most cases, 
been the final examination administered 
in the course for the purpose of deriving 
course grades. A given level of perform- 
ance on a final examination does not, how- 


*This research was conducted under a 
grant to Miami University from the Fund 
for the Advancement of Education. 

* Now at Temple University. 


ever, guarantee a comparable level of 
subject matter retention after a lapse of 
time. 

The present investigation was directed 
toward a comparative study of the effect 
of certain instructional procedures upon 
subject matter retention after a time lapse 
of from one to two years. 


PROCEDURE 


Teaching Procedures 


Miami University’s Experimental Study 
in Instructional Procedures has, since 1956, 
been investigating the comparative effec- 
tiveness of large group and small group 
(25 to 35 students) instruction. Three of 
the general approaches to large group in- 
struction which have been investigated are 
designated TV (closed circuit television 
classes), LC (large classes with direct 
visual contact between student and in- 
structor), and GS (instruction by gradu- 
ate student assistants in classes of con- 
ventional size). The latter instructional 
procedure is classified as a large group 
technique because it increases the ratio of 
undergraduate enrollments to full-time 
faculty members. 

Every comparison that has been made 
required a preliminary pairing of an ex- 
perimental section (TV, LC, or GS) with 
at least one control (conventional) sec- 
tion. Students in both types of section 
were equated on the basis of tests of aca- 
demic ability and measures of prior 
achievement. The control classes paired 
with the TV and LC sections were taught 
by the same instructor as taught the ex- 
perimental sections. The control classes 
for GS sections, however, were taught by 
full-time faculty members rather than by 
graduate students. 
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Subjects 

The subjects (Ss) for the present in- 
vestigation were those students who ‘were 
enrolled in the experimental or control 
sections of nine different courses during 
the 1956-1957 and 1957-1958 academic 
years and were still in residence in April 
1959. Since these nine courses are intended 
primarily for freshman and sophomore stu- 
dents, and since Miami University pursues 
a policy of nonselective admission of Ohio 
residents, there was considerable attrition 
in the number of available Ss. Contacts 
were made with a total of 1277 students 
who were still in residence of approxi- 
mately 3000 students originally enrolled 
in the experimental and control sections of 
the nine courses. The proportion of stu- 
dents still in residence after the elapsed 
time corresponds roughly to the percentage 
of incoming students who are graduated. 

Each of the 1277 Ss available for the 
retention study received a letter informing 
him of the fact that he was to report to 
a given room on campus at a specified 
time for research purposes. Although these 
students knew that the request came from 
the office of the Experimental Study in 
Instructional Procedures, they were not 
informed about the specific nature of the 
task they were to perform. 

The letters were sent with a degree of 
trepidation lest an insufficient number of 
Ss appear at the scheduled time, and those 
who would appear would be poorly mo- 
tivated. Both of these fears proved to be 
groundless. The retention tests were ad- 
ministered to 1022 students, representing 
80% of the group contacted. The tests 
were proctored by the instructors who had 
taught the course originally, and they re- 
ported a uniformly high level of student 
motivation. This was substantiated by the 
fact that a considerable number of stu- 
dents subsequently inquired about their 
performance on the retention test. 

It was not possible to use the results of 
all 1022 Ss tested. The sample was a 


composite of students who had taken 
courses in two different academic years. It 
was necessary, therefore, to weight the ex- 
perimental and control sections equally 
with respect to proportional representa- 
tion of students who had taken the course 
during each of these years. This meant 
that certain of the Ss tested had to be 
deliberately eliminated from the sample. 
Eliminated cases were randomly deter- 
mined by alphabetizing within each course 
and dropping every nth case. This pro- 
cedure reduced the number of Ss actually 
used for the study to 744. 

The number of Ss within each course 
who were tested and who were actually 
used for research purposes is shown in 
Table 1. 


Method 


The retention tests administered to the 
Ss consisted of selected objective items 
(primarily multiple choice in nature) from 
those that comprised the final examina- 
tions administered during the two previous 
academic years. These items were selected, 
in most cases, on the basis of item analysis 
data supportive of their discriminative 
power. The tests were suitable in length 
for administration during a 50-min. ses- 
sion, although the specific number of items 
in each retention test differed. 

It was originally planned to analyze the 
retention test scores as a function of in- 
structional procedure separately for the 
1956-1957 group and the 1957-1958 group. 
This plan, which would have yielded in- 
formation about retention after one year 
and after two years, had to be abandoned 
because many of the groups were insuffi- 
cient in size. Consequently, an alternative 
procedure involving the pooling of data 
regardless of year the course was taken 
was followed. Thus the data presented 
herein are indicative of the retention test 
scores earned by students enrolled in the 
course both one and two years prior to 
the time they were tested. 
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TABLE 1 
Tue SAMPLES 
Students Enrolled in Students Enrolled in 
1956-1957 1957-1958 Total 
Course Section Ns Used 
N Tested WN Used N Tested WN Used 

Zoology TV 52 52 52 
Control 30 30 30 

Air Science TV 17 17 39 22 39 
Control 13 7 9 9 16 

Educational Psychology TV 36 35 59 43 78 
Control 15 13 17 16 29 

Introd. Psychology LC 20 17 29 19 36 
Control 18 8 ll 9 17 

Freshman English LC 24 17 100 36 53 
Control 20 ll 33 23 34 

Social Studies LC 10 s 29 28 36 
Control 10 8 29 28 36 

Geography LC 60 49 52 46 95 
Control 23 15 14 14 29 

Introd. Business Gs 23 22 83 41 63 
Control 34 6 ll ll 17 

Geology GS 27 27 51 38 65 
Control 12 8 12 12 20 


RESULTS 


Aside from the retention test scores, 
other data available for these Ss included 
their final examination scores earned at 
the time they were enrolled in the course, 
and their scores on the American Council 
on Education Psychological Examination 
(ACE) and the Cooperative English test 
administered routinely to all incoming 
freshmen. 

The final examination scores earned at 
the time the students were enrolled in the 
courses were analyzed to determine 


whether the Ss from the experimental and 
control sections of these courses were 
comparable with respect to original level 
of achievement. This analysis took the 
form of computation of t ratios to test 
the significance of the differences between 


the mean final examination scores of ex- 
perimental and control group Ss. The null 
hypotheses were not refuted. Original level 
of achievement was therefore not con- 
sidered to be a factor of consequence with 
respect to retention scores. 

The differences between mean retention 
test scores earned by subjects from the 
experimental and control sections of each 
course were tested for significance by anal- 
yses of covariance. The control variable in 
these analyses was the total ACE score for 
all courses with the exception of Fresh- 
man English. The control variable in this 
instance was the total score on the Co- 
operative English test. Scores on the con- 
trol variables and the retention tests along 
with the appropriate F ratios are sum- 
marized by course in Table 2. 
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TABLE 2 
Summary or ACE anp RETENTION Test Scores 


ACE Retention Test 
Course Section N F Ratio* 
Mean SD Mean SD 
Zoology TV 52 | 113.77 | 18.33 | 26.73 | 6.39 0.21 
Control 30 | 119.63 | 17.51 | 27.23 | 5.94 ' 
Air Science TV 39 | 112.26 | 17.23 | 46.62 | 7.63 0.36 
Control 16 | 111.69 | 21.82 | 47.44 6.02 ’ 
Educational Psychology TV 78 | 111.19 | 18.97 | 31.19 | 4.53 11 
Control 29 | 107.79 | 15.96 | 31.69 | 5.12 : 
Introd. Psychology LC 36 | 117.36 | 16.75 | 29.39 | 7.73 1.06 
Control 17 | 122.41 | 16.72 | 29.82 | 8.04 , 
Freshman English LC 53 | 179.87>) 18.67 | 31.94 | 6.45 0.34 
Control 34 | 178.81>) 23.02 | 32.32 | 4.90 
Social Studies LC 36 | 112.06 | 17.08 | 21.92 | 5.65 0.89 
Control 36 | 105.06 | 22.16 | 21.69 | 5.94 ' 
Geography LC 95 | 110.62 | 18.13 | 25.96 | 4.60 0.55 
Control 29 115.03 | 17.72 | 27.52 | 6.28 ? 
Introd. Business GS 63 | 112.12 | 18.96 | 24.71 | 4.67 0.40 
Control 17 | 109.41 | 20.17 | 25.47 | 4.23 : 
Geology GS 65 | 113.86 | 19.15 | 23.03 | 5.25 0.20 
Control 20 | 113.10 | 12.90 | 24.45 | 4.83 : 


h 


of freedom for each F ratio is 1: total N — 3 


® Analysisof covariance controlling on ACE. The 


of degr 


> Total scoreon the Cooperative Test of English Achievement was used as the matching avariable instead of ACE 


Since none of the F ratios approach sta- 
tistical significance, the null hypotheses 
cannot be rejected. It appears, within the 
scope of the present investigation, that re- 
tention of subject matter a year or two 
years after completion of a course is not 
adversely affected by increased class size 
or by the instructional procedures em- 
ployed in this research. 


SuMMARY 


The purpose of this investigation was to 
determine the effect, if any, of instruc- 
tional procedure upon subject matter re- 
tention one year or more after completion 
of a course. Retention scores of students 
who had received conventional instruc- 


tion in nine courses were compared with 
the scores of students who had been in- 
structed in the same courses by large 
group procedures: closed circuit television, 
large group (but not televised) instruc- 
tion, and instruction by graduate student 
assistants rather than by full-time faculty 
members. 

Of 1277 students, 80% (those who were 
still in residence of approximately 3000 
students originally enrolled in the experi- 
mental and control sections) complied with 
a request to participate in the experiment. 
The retention test scores (based on ob- 
jective items selected from the final ex- 
aminations) were compared, with control 
on total ACE scores for eight of the courses 
and on the Cooperative English test score 


1 
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in the ninth course (Freshman English) 
being exercised by analysis of covariance. 

None of the F ratios approached sta- 
tistical significance. Hence, it appears, 
within the limits of the present investiga- 
tion, that retention of subject matter a 
year or more after completion of a course 
is not adversely affected by increased class 
size or by the particular instructional pro- 
cedures used. 
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THE EFFECTS OF TIME LIMITS ON THE 
INTELLIGENCE TEST PERFORMANCE 
OF MEXICAN AND AMERICAN 
SUBJECTS’ 


ROBERT R. KNAPP? 
Naval Medical Field Research Laboratory, Camp Lejeune, North Carolnia 


The development and application of 
cross-culture, culture fair or culture free, 
tests of general mental ability have re- 
cently been the focus of a great deal of 
investigatory effort. The desirability of 
measures as uncontaminated as possible 
by the effects of diverse environmental in- 
fluences becomes evident where culturally 
heterogeneous groups are to be tested, such 
as are often found in the United States with 
its large bilingual and foreign born seg- 
ments. Recent studies such as those of Ke- 
ston and Jimenez (1954), and Roca 
(1955) have demonstrated that many of 
our widely used, predominantly verbal tests 
are not suitable measures for certain cul- 
tural groups. Findings of this nature have 
led to the development of cross-culture 
tests which, being nonverbal, are more ap- 
plicable than verbal tests when, for any 
reason, the individual being tested is un- 
duly handicapped by the language of the 
test. Many studies (Bajard, 1955; Bens- 
berg & Sloan, 1955; Goosens, 1952) have 
demonstrated the usefulness of the cross- 
culture test in minimizing cultural in- 
fluences, although a few studies (Anastasi 


* This study is based in part on data col- 
lected while the author was with the United 
States Public Health Service at their San 
Ysidro, California, Quarantine Station and 
is part of the writer’s M.A. thesis submitted 
to the Department of Psychology, San Diego 
State College. The opinions expressed here 
are the author’s and do not necessarily repre- 
sent those of the United States Public Health 
Service nor of the Navy Department. 

*The author is especially indebted to 
Robert C. Harrison for advice throughout 
all phases of the investigation, and to Alex- 
andro Yiigo for his work in translating and 
recording the Spanish instructions. 


& Cordova, 1953; Harper, 1953) have in- 
dicated that even the current cross-cul- 
ture tests are not always free of cultural 
bias. Varied familiarity with given test 
materials on the part of different groups, 
difficulties in adapting certain test items, 
and even problems arising from the trans- 
lation of instructions have been found to 
influence test results. 


PROBLEM 


The purpose of the present investiga- 
tion was to test the influence of one factor, 
time limitations, on the test scores of rep- 
resentatives from two diverse cultural 
groups. The hypothesis considered was 
that differences between power and time 
limit (which for present purposes will 
henceforth be termed speed) scores would 
be greater for subjects from a culture 
which is considered to be less “geared to 
the clock” than that found in the United 
States. 


METHOD 


The Test 


The test used in the present investi- 
gation was the Cattell Culture Free In- 
telligence Test, Forms 2A and 2B. This 
test is a paper-and-pencil, perceptual or 
spatial test consisting of abstract geo- 
metrical forms having certain relationships 
to each other which must be educed before 
each item, or sequence, can be satisfacto- 
rily completed. Test norms were based on 
time limits of 3, 4, 3, and 4 minutes for 
Subtests 1, 2, 3, and 4, respectively, which 
were the time limits used in the present in- 
vestigation following the instructions given 
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in the test manual (Cattell & Cattell, 
1954). Test instructions were translated 
into Spanish by a native Mexican citizen 
whose mother tongue was Spanish, and 
the Spanish and an English version were 
recorded on magnetic tape. Instructions 
were then given to both cultural groups 
with the aid of a tape recorder. All tests 
were administered by the writer, and any 
additional help needed was given by re- 
peating key phrases from the instructions. 


Procedure 


The design for test administration, 
which was replicated for the two cultures, 
is shown in Table 1. In the final analysis, 
Group 1 and Group 3 in Table 1 were 
combined as a power first, speed second 
group in each culture and Group 2 and 
Group 4 were combined as a speed first, 
power second group. This counterbalanced 
any form differences and made it possible 
to make meaningful statements regarding 
any overall gains from the first to the 
second session which would be due to 
practice effects. Cattell and Cattell (1954, 
p. 3) state that the two forms were equiva- 
lent, but since this equivalence might not 
hold for the present conditions the study 
was designed to counterbalance test form 
and thus make the assumption of equality 
of forms less crucial. 

The tests were administered in small 
groups of from 3 to 14 with a modal size 
group of 5 for both cultures. The battery 
of two tests was administered one im- 
mediately following the other after which 
a questionnaire was administered to facili- 
tate description of the samples. The sub- 
jects were assigned to one of the four 
groups shown in Table 1 in the order in 
which they presented themselves for test- 
ing. 


Subjects 


The Ss used in the present analysis were 
100 Mexicans and 100 Americans. The 


*The term American, although not inap- 
propriate for the sample taken from among 


TABLE 1 
DesiGn oF Test ADMINISTRATION 
Test Session 
Testing 


II 


Group 


Group 1 |Form A: Power [Form B: Speed 
Group 2 |Form A: Speed |Form B: Power 
Group 3 |Form B: Power |Form A: Speed 
Group 4 Form B: Speed |Form A: Power 


Mexican Ss were all male Mexican citizens 
of Spanish and/or Indian descent who 
were applying for visas to enter the United 
States. Ss were not instructed one way or 
the other as to the possible effect scores on 
this test might have on their immigration 
status, although the present project was 
made a part of the processing of these ap- 
plicants, thus tending to assure a high 
level of motivation. Almost all the appli- 
cants entering the United States during the 
duration of this project were tested. The 
American Ss were taken on a voluntary 
basis from job applicants at a large air- 
craft company in California. They were 
asked by the secretaries in the employ- 
ment department to participate in the ex- 
periment while waiting for their job in- 
terviews. Nothing of the nature of the 
investigation was told them, but they were 
informed that the results would not affect 
their chances of securing employment, and 
that it would not be necessary to put their 
names on the papers unless they were in- 
terested in receiving their scores. Virtually 
all of the Ss (98%) put their names on 
the papers and this is held to be indicative 
of a high level of motivation for those 
taking the test. Of the total number of 
individuals approached, 25% declined and 
thus were not included in the study. 
The mean age of the Mexican sample 
was 27.3, with a range from 14 to 50. 
Exactly 50% of the cases were 25 years 


Mexican citizens, will be used to describe 
that sample taken from among United States 
citizens for lack of a better, yet concise, 
term. 
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old or younger. The mean age of the 
American sample was 31.4 with a range 
from 18 to 60. Almost half the cases (49%) 
were 28 years old or younger. The age dis- 
tributions for both cultural samples were 
approximately normal. Ss younger than 
14 were not tested since Cattell and Cattell 
(1954, p. 9) state that there are no ex- 
perimentally determinable mental ages be- 
yond that age, and thus the raw scores are 
comparable. 

The mean number of years of schooling 
for the Mexican sample was 4.9, with the 
range being from 0 to 17 and one unre- 
ported. Over half the cases (56%) had 
four or less years of school, with the mode 
being three years. The mean number of 
years of schooling for the American sample 
was 11.5, with a range of 7 to 20. Only 
42% of these cases had less than 12 years 
of school, and the mode fell at 12 years. 
The distributions of educational level of 
the two samples were found, by inspection, 
to be quite different, as the above would 
suggest. Since it was desired that the sam- 
ples employed be based, as nearly as was 
feasible, on random selection of individuals 
from the larger visa applicant and job ap- 
plicant populations, no attempt was made 
to control or match the samples on any 
variables, with the exceptions of sex and 
the limitation of age to 14 years and over 
as discussed above. Differences, especially 
on such variables as education and oc- 
cupation, are to be expected in the sam- 
ples resulting from cultural differences be- 
tween the two countries. 

The occupations represented in the 
Mexican samples ranged from the agri- 
cultural occupations, primarily field work- 
ers which represented the largest single 
occupation, to one doctor. When classified 
into the seven major occupational groups 
according to the Dictionary of Occupa- 
tional Titles (U.S. Department of Labor, 
1957, pp. 671-680), it was found that 
36% reported that their job was that of 
field worker and 15% reported that they 
worked as unskilled labor of various types. 
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Estimates of 65% rural, and 60% peasant 
working class have been reported for the 
total Mexican population (Trade & Travel 
Publications, 1957-1958, p. 762). Thus 
the 51% peasant proportion found in 
the present sample may be considered 
as closely approximating that proportion 
found for the country as a whole. The 
largest occupational group among the 
Americans was the skilled occupational 
group, and the diversity of occupations 
represented was as great as among the 
Mexicans. All seven major occupational 
groupings were represented in each cul- 
tural sample. 

Only 19% of the Mexican sample had 
never entered the United States prior to 
this examination, but a total of 32% had 
spent less than four months in the United 
States. The average length of time spent 
in this country was 3.4 years, with one S 
having lived here periodically for 12 years. 


RESULTS 

Test Reliability 

Split-half (odd-even) reliability coef- 
ficients were computed separately for each 
form of the test under the various sub- 
groupings by test conditions and cultures. 
Coefficients ranged from .90 to .92 for the 
Mexican sample and from .71 to .89 for 
the American sample under the power 
condition. 


Analysis of Variance 


Table 1 illustrated the design of test 
administrations. In that table it was noted 
that half the Ss received the speed test 
during the first session and the power test 
during the second session, while the other 
half received the test in reverse order. Of 
the Ss taking the test in the speed-power 
order, half received Form A under the 
speed condition and Form B under the 
power condtion, while for the other half 
the forms were reversed. The same was 
true for Ss in the power-speed order. 
Since the use of Forms A and B was coun- 
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TABLE 2 
ANALYSIS OF VARIANCE 
Source of Variation Sum of Squares df Variance Estimate F Ratio 
Culture 27367545 .96 1 27367545 .96 760 .487** 
Test condition 6786025 .00 1 6786025 .00 188.570** 
Session 2193064 .81 1 2193064 .81 60.941** 
Order 576536 .49 1 576536 .49 16.021** 
Culture X Test condition 353549 .16 1 353549 . 16 9.824* 
Culture X Session 57456 .09 1 57456 .09 1.597 
Culture X Order 43722.81 1 43722.81 1.215 
Subjects (within order within 
culture) 52530009 . 55 196 268010 .25 7.447* 
Subjects X Session (error) 7053425 .13 196 35986 . 86 
Total 96961335 .00 399 


* Significant at the .01 level. 
** Significant at the .001 level. 


terbalanced, the scores on the two forms 
were pooled among Ss taking the test under 
the same order of presentation. This gave 
two groups for each culture, a power-speed 
group and a speed-power group. 

The design is essentially the same as 
that described by Grant (1949) for a 2 x 
2 latin square, except for the addition of 
another variable and the computation of 
the additional interactions, and is nearly 
identical to that used by Anastasi and 
Cordova (1953). 

Bartlett’s test of homogeneity of vari- 
ance was applied to the eight subgroups in 
the present design, and the obtained chi 
square values were significant at the .01 
level necessitating a transformation of the 
data. After use of a square transformation, 


highly significant value of F for the cul- 
ture variable demonstrates that there was 
a large overall difference between the test 
scores of the Mexican and American Ss, 
and from inspection of the mean values 
contained in Table 3 it was noted that the 
means for the Mexicans are all lower than 
the corresponding means for Americans. 
The F ratio for test condition was sig- 
nificant beyond the .001 level, and Table 
3 shows that for both the American and 
Mexican samples the mean scores are 
higher under power conditions than under 


TABLE 3 
Test ScorE MEANS AND CORRESPONDING 
IQ VALUES* FoR THE Two CULTURES 
UNDER THE Test CoNDITIONS OF PowER 


with each S’s raw score squared through- am Soap 

out, chi square values did not reach signifi- —— Session 2 

cance at the .05 level, and therefore the ow 

variances were treated as homogeneous. Ameri-| Mexi- | Ameri-| Mexi- 

For the analysis of variance, the Ss X ee ee 

session interaction was used as the error Order I | Mean\30.18 |17.44 (35.38 (28.02 

term in computing F ratios. The results (Speed- | IQ 95>) 53>) 114 81 

of this analysis are summarized in Table Power) 

2. From examination of that table, it can Order II | Mean/35.10 /26.06 |33.74 |23.00 

be seen that of eight F ratios computed Fower- | 58 — Fo 
g mputed, Speed) 

four (culture, test conditions, session, and 


order) were significant at the .001 level. 
Two, culture xX test condition, and Ss 
were significant at the .01 level. The 


* Converted to Classical IQ values from the table 
given by Cattell and Cattell (1954, p. 7). 

> These values are for the test condition of speed 
upon which the norms for the test are based. 
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speed conditions. The difference between 
Session I and Session II was also highly 
significant. The overall mean gain from the 
first to the second session was 3.76 for 
the Mexicans and 1.92 for the Americans, 
although the nonsignificant culture X ses- 
sion interaction indicates that this gain 
was not significantly greater for one cul- 
tural group than the other. Since the gain 
from session to session was not significantly 
greater for the Mexican sample, it would 
appear that test sophistication as such 
was not a major contributing factor to 
the differential effects noted throughout 
the study. 

The order effect was significant beyond 
the .001 level. From examination of the 
data, it was seen that this order effect is 
most evident when noting the highly 
detrimental effects of administering a 
speed test on the first session, Order I. 
For those Mexican Ss in Order I, the 
mean increase in going from a speed test 
in Session I to a power test in Session II 
was 10.58 points, while the decrease in 
mean scores for Order II in going from a 
power test in Session I to a speed test in 
Session II was only 3.06 points. The cor- 
responding mean changes for the Ameri- 
can sample was 5.20 for Order I and 1.36 
for Order II. Although the order of presen- 
tation produces a significant, overall dif- 
ference it is noted from the nonsignificant 
culture X order interaction that the ef- 
fects of this variable were not significantly 
different for the two cultures. 

The culture X test condition interaction 
is the crucial test of the hypothesis in 
the present investigation. Test score dif- 
ferences between power and speed test 
conditions would result in a significant 
interaction if these differences were rela- 
tively greater for one cultural group than 
for the other. In the present study, this 
interaction was significant at the .01 level. 
Thus, there was found to be a differential 
effect resulting from the imposition of time 
limits on the test performance of the sam- 
ples under investigation, as hypothesized. 
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Finally, the Ss within order, within cul- 
ture variance was significant at the .01 
level which shows that, despite significant 
improvement from first to second adminis- 
trations, Ss tended to maintain their rela- 
tive positions in the group. That is, indi- 
vidual differences were significant and were 
maintained throughout both sessions. 


Discussion 


In terms of the major hypothesis under 
consideration, the most important finding 
of the present study was that the imposi- 
tion of time limits on a paper-and-pencil 
cross-culture intelligence test was signifi- 
cantly more detrimental to the scores of 
Mexican visa applicants coming into this 
country than to the scores of a group of 
American job applicants. But, before any 
attempt is made to generalize to the whole 
Mexican culture, it should be noted that 
the interpretation of this finding is not un- 
equivocal. 

A possible interpretation of the results 
might be sought in terms of intellectual 
rather than cultural differences between 
the two samples. The Mexican sample in 
the present study scored well below the 
American sample under both power and 
speed conditions, as can be seen from an 
examination of the data in Table 3. It is 
possible that low IQ people in general are 
handicapped more by the imposition of 
time limits than are people of average or 
above average intelligence. To evaluate 
this possibility, the two groups of Mexi- 
can scores were divided into a high and 
low IQ group. For Order I, the speed- 
power order, the above median half had 
a mean power test score of 35.24 and a 
mean speed test score of 21.64, a difference 
of 13.60 points, while the below median 
half had a mean power test score of 20.80 
and a mean speed test score of 13.24, a dif- 
ference of only 7.56 points. For Order II, 
the power-speed order, the above median 
group had a mean power test score of 32.68 
and a mean speed test score of 29.48, a 
difference of 3.20 points, while the below 
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median group had a mean power test score 
of 19.44 and a mean speed test score of 
16.55, a difference of 2.92 points. Therefore, 
as far as can be determined from this type 
of treatment of the present data, it appears 
that among the Mexicans in both orders, 
those most handicapped by time limits were 
not the lower scoring individuals but, in 
fact, the evidence suggests that the higher 
scoring individuals may be more handi- 
capped. This finding offers at least partial 
evidence against the contention that the 
significant culture X test condition interac- 
tion found in the present study resulted 
from intellectual rather than cultural dif- 
ferences between the two samples. 

It is also conceivable that the lower 
scores of the Mexican Ss were in part due 
to the effects of stress inherent in the im- 
migration process, with the addition of the 
time element accentuating the stress and 
yielding results which might not obtain 
under other conditions. While the impor- 
tance of this variable is difficult to assess, 
it is the author’s opinion that stress inher- 
ent in the particular testing conditions was 
not a major contributing factor to the poor 
performance of the Mexican Ss. 

In addition to the above considerations 
and in spite of the fact that the differential 
effects of speed in the present study ap- 
pear to be the result of cultural factors, 
it must be remembered that neither the 
American nor the Mexican samples can be 
considered as random samples from their 
respective cultures which could also limit 
the applicability of the present results to 
other conditions and samples. However, it 
might be argued that such broad cultural 
factors as emphasis on the importance of 
time permeate the entire culture, and could 
be expected to show an influence even with 
samples that are not completely represen- 
tative of the whole culture. 


SuMMARY 


The present study tested the hypothesis 
that the intelligence test scores of a Mexi- 


can immigrant sample obtained under test 
conditions of speed would be relatively 
more depressed as compared with their 
scores under power conditions than would 
the test scores of American Ss. Two samples 
of 100 each, one of adult male Mexican 
visa applicants and the other of American 
male job applicants at a large aircraft com- 
pany, were given the Cattell Culture Free 
Intelligence Test under two testing condi- 
tions, power and speed, and the test scores 
were subjected to an analysis of variance. 

The results indicated that while both the 
Mexican and American Ss scored higher 
under power conditions than under speed 
conditions, the difference was significantly 
greater for the Mexicans than for the 
Americans. It was also found that the Mex- 
ican sample scored significantly lower than 
the American sample in terms of overall 
mean scores. However, the possibility that 
the differential effect of test conditions was 
produced by differences in intellectual lev- 
els between the two samples rather than by 
cultural differences was not supported by 
available data. 

In addition there was a significant in- 
crease in test scores from the first to the 
second administration of the test, but not 
significantly greater for the Mexican Ss 
than for the American Ss, indicating that 
the differential effect of test conditions was 
probably not due to differences in test so- 
phistication. 

It was further noted that scores were 
significantly higher in the power-speed 
order of presentation than in the speed- 
power order. This suggests that a speed test 
on the first administration puts all Ss, both 
Mexican and American, at more of a dis- 
advantage than when the speed test fol- 
lows a power test. 
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INSTRUCTOR RATING BY COLLEGE STUDENTS 


CARL H. WEAVER’ 
Central Michigan University 


The rating of college instructors by their 
students is by no means universally ac- 
cepted among college staffs nor well under- 
stood. Ryans (1954) discussed the attitude 
of college instructors toward student rating 
and listed four reasons why instructors are 
generally opposed to having their stud- 
ents rate them. A research project con- 
ducted by Royce (1956) suggested that 
high ratings were in large part attributable 
to a halo which he called “superficial popu- 
larity.” 

Most of the research on this problem 
has been concerned with the relation be- 
tween the rating made of the instructor 
and the grade received in the course. Rem- 
mers (1939), Eckert (1950), and Bendig 
(1953) found no relationships which were 
significant. Remmers, Martin, and Elliott 
(1949) found no significant differences be- 
tween the ways overachievers and under- 
achievers rated their instructors. Russell 
and Bendig (1953) however, discovered 
that overachieving disposed the student 
favorably toward the course, but not to- 
ward the instructor. 

Anikeef (1953) investigated the rela- 
tionship between the rating given the 
instructor by a student and his perception 
of his own achievement, i.e., the student 
ratings were made after the midsemester 
grades had been posted, but before final 
course grades were posted. For analysis, 
however, the students were grouped ac- 
cording to final grades received. Anikeef 
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sion, 


concluded that the ratings depended upon 
the grading leniency of the instructor. 

This research was designed to investi- 
gate the following questions: 

1. Do students, when rating an instruc- 
tor, tend to give him about the same 
kind of grade they expect to receive in 
the course? 

2. Is student criticism of an instructor 
directed toward both his personality and 
his teaching skill, i.e., does halo in one of 
these areas determine ratings in the other? 


PROCEDURE 


The rating sheet used in this study was 
the same instrument which had been used 
in the university for several years, and it 
is likely that at least some of the students 
who marked it had seen it before. It pro- 
vided for the rating on a five-point scale 
of seven aspects of the personality of the 
instructor (voice, personal mannerisms, 
interest and enthusiasm, appearance, range 
of interests, sense of proportion and hu- 
mor, and poise). The instructor’s teaching 
skills and abilities were rated by 19 items, 
including such aspects of teaching tech- 
nique as participation by students, the in- 
structor’s knowledge and organization of 
subject matter, variety in classroom pro- 
cedure, aims and objectives of the course, 
assistance with students’ difficulties, class 
management, outcomes of instruction, abil- 
ity to awaken interest and effort, ete. The 
rater was asked to circle one of five de- 
scriptive terms for each item: poor, below 
average, average, above average, and ex- 
ceptional. The scale was printed on both 
sides of a single sheet of paper. Thus, there 
was no rotation of items. The rating of the 
instructor’s personality was presumably al- 
ways made before the rating of his teach- 
ing technique since it was printed on the 
top of the front page. 
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The rating was done shortly before final 
examinations during the second semester 
of the university year. Thus the raters had 
had at least one semester’s experience with 
the instructor rated, and in some cases 
two semesters. Presumably, every student 
had some idea of his own performance in 
the class and an expectation of the grade 
he would receive in the course as a result 
of midsemester examinations and other 
marks. Twelve instructors of English, his- 
tory, personnel, and speech were rated by 
39 classes. Raters were all undergraduate 
students, and ranged from the first to the 
fourth year in college. 

The instructor handed the rating sheet 
to the students in the classroom, read the 
sheet of instructions, and remained in the 
room while the papers were being marked. 
Students were asked to rate the instructor 
on every item and to write on the sheet 
the grades which they expected to receive 
in the course. The rating sheets were not 
signed. A student in the class was provided 
with an envelope in which he sealed the 
rating sheets and which he delivered im- 
mediately to the experimenter. The enve- 
lopes were not delivered to the instructor 
until after the semester grades had been 
reported to the registrar. After inspection, 
the instructor returned the rating sheets 
to E by shuffling them among sheets bear- 
ing students’ ratings of other instructors. 
Thus there was no identification of either 
instructor or students, and this was pre- 
sumably clearly understood by the raters 
before the rating was done. 

No effort was made to differentiate 
among methods of teaching, personalities 
of instructors, need-structures of the rat- 
ing students, ete.; rather, the large sample 
(699 students, 39 classes in four disciplines, 
and 12 instructors) was expected to allow 
cancellation of random variation on these 
variables. This procedure was considered 
necessary in order to preserve the ano- 
nymity of both instructors and students, 
which seemed important in this study. 
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RESULTS 


A total of 699 rating sheets was com- 
pletely filled in, including the expected 
grade in the course. Only two papers were 
discarded because of evidence that the 
marking was insincere. Many raters wrote 
explanations, etc., in the margin, suggest- 
ing eagerness to achieve understanding, 
and thus sincerity in performing the task. 

The instructors’ rating scores were tal- 
lied for the total instrument (26 items), 
for the personality rating (7 items), and 
for the rating of the teaching techniques 
(19 items). One point was tallied for a 
“poor” rating, two points for “below aver- 
age,” ete. Thus an instructor might, if 
rated “exceptional” by a student on every 
item achieve a score of 130 on the total 
instrument, 35 on personality, and 95 on 
teaching techniques. 

The rating sheets were sorted into four 
groups according to the grades the stu- 
dents expected to receive in the course. 
Only one student reported an expectation 
of E. This one was added to the group who 
expected to receive D’s in the course, mak- 
ing a total of 30. Thirty-one students ex- 
pected A’s, 268 expected B’s, and 370 ex- 
pected to receive C’s. 

The mean ratings ascribed to instructors 
by each group are presented in Table 1. 
As expected, the mean total score for all 
groups was above the scale “average” 
(92.40) or about 3.55 on the five-point 
scale. The mean scale rating for all groups 
on the 7 personality items was 3.84 and 
on the 19 teaching technique items 3.48. 

The differences between means of the 
ratings assigned instructors by the four 
groups are shown in Table 2, along with 
the values for t. It may be seen that the 
difference between the ratings given by 
students who expected to receive B’s in 
the course and ratings assigned by stu- 
dents who expected to receive C’s was sig- 
nificant beyond the .01 level of confidence, 
both on the total score and on the teach- 
ing technique score. Likewise, when the 
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TABLE 1 


Mean RatinGs or CoLLeGe Instructors By 699 StupENTs GRoUPED ACCORDING 
To GRADB EXPBCTATIONS 


A B Cc D Possible 
(N (N=268) (N=370) (N = 30) Score 
Total score 96.10 94.56 91.15 84.63 130 
SD (13.91) (12.47) (11.51) (21.33) 
Personality score 26.45 27 .27 26.60 27.40 35 
SD (4.27) (3.57) (2.60) (11.91) 
Teaching Technique score 69.94 67.36 65.14 61.47 95 
SD (11.07) (9.82) (6.36) (11.15) 
total student sample was divided into an TABLE 2 
DIFFERENCES BETWEEN GROUP MEAN 


“upper” and a “lower” group (A plus B 
and C plus D), the value for t was highly 
significant for both the total score and the 
teaching technique score. 

The fact that only one significant dif- 
ference was found in the ratings of per- 
sonality implies that the significant dif- 
ferences among the groups on the total 
score must have arisen largely from the 
teaching technique score. Support for this 
inference may be seen in similarity of the 
values for ¢ for differences in the total 
score and in the teaching technique score, 
and in the small size of the differences on 
the personality score. 

Some information about the intragroup 
behavior of student raters may be inferred 
from the standard deviations of the group 
ratings listed in Table 1. It should be 
noted that the students who expected to 
receive D’s consistently agreed among 
themselves less well than the others. In- 
spection of written comments on the rat- 
ing sheets of these students suggested that 
this phenomenon arose from the presence 
in this group of some students of low 
ability, who were grateful for even this 
level of achievement and who gave the 
instructor credit for it, both by rating 
him relatively high and by writing notes 
of explanation in the margin. Other stu- 
dents who expected D’s in the course 
displayed the general bias illustrated in 


Scores Given INSTRUCTORS BY 
Four Groups or StupENTs CLASSIFIED 
AcCORDING TO GRADE EXPECTATIONS 


A— c- A+B-— 
B-C A-D C+D 


Total 1.52)'3.40 (6.52)11.46 (7.43 
Score 


t= .59|3.42***/1.65) 2.48* |4.54*** 

Personal- | .82) .67 .80) .95 .28 
ity score 

t= 1.03/2.61** | .17) .41 .95 


Teaching |2.57/2.22 (3.68) 8.47 (5.34 
Tech- 
nique 
score 

t= 1.24)3.24*** 1.78 2.98**'5.00°** 


* Significant at the .02 level of confidence. 
** Significant at the .01 level of confidence. 
*** Significant at the .001 level of confidence. 


Table 1 of assigning to the instructor about 
the same grade one expects to receive from 
him. The relatively large dispersion of 
scores apparently caused by these two 
kinds of bias appears most clearly in the 
standard deviations of the total score and 
of the personality score. 

The student raters who expected to re- 
ceive C’s in the course agreed with each 
other most consistently, the standard de- 
viation of their ratings being the smallest 
on all three scores assigned. It should be 
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observed that the standard deviations of 
the two groups at the left of the C group 
in Table 1 are consistently larger on all 
three scores, the B group agreeing less 
well than the C group, and the A group 
agreeing less well than the B group. These 
differences between the standard devia- 
tions of the C group and the standard 
deviations of the other groups are sta- 
tistically significant on both the person- 
ality score and the teaching technique 
score at levels ranging from P = .02 to 
P = .001. On the total score, the dif- 
ferences between the standard deviation 
of the C group and those of the A and 
B groups are not large enough to be sig- 
nificant, but the difference between the C 
group and the D group is significant at the 
.001 level. 

The pattern is most noticeable in the 
teaching technique score, where the stand- 
ard deviation of the ratings by students 
who expected to receive A’s in the course 
is not significantly different from that of 
those who expected to receive D’s. It 
might be hypothesized that as we leave the 
C (average expectation) group and move 
in the direction of higher student expecta- 
tion (B and A students) we encounter 
greater alertness and evaluating ability; 
ie., whereas the average students were 
generally inclined to accept any kind of 
instructor behavior as somewhat ade- 
quate, the above-average students were 
most discriminating in their judgments. 
The general bias operating in the total 
sample (toward assigning an instructor 
a lower grade if the student expected to 
receive one) operated less consistently in 
those students whose ability had allowed 
them to develop greater discrimination. 
This hypothesis would suggest that the 
largest group of students studied (the C 
group) used least discrimination, since 
their dispersion of scores was consistently 
lowest. It may be that students in this 
group were operating in large part upon 
a culturally established norm widespread 
in the university community: that this is 
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the way instructors behave in the class- 
room and therefore it is adequate. Their 
lower discriminative abilities did not inter- 
fere with the operation of this norm, and 
the two opposing biases apparently oper- 
ating in the D group were relatively weak 
here. Perhaps the most noticeable effect 
upon the operation of this norm was the 
impingement of the general bias measured 
in this study, viz., the tendency to assign 
to the instructor the kind of rating on 
teaching techniques which one expects to 
receive from him. 

It should be noted that the size of the 
differences among the student groups is 
not only statistically significant but also 
of real importance. The average difference 
between a rating made by a student who 
expected to receive an A and a rating 
made by a student who expected to re- 
ceive a D was about 11.5 points. In the 
absence of other pertinent information, an 
instructor’s best guess as he inspects a 
rating made by a D student on the rating 
seale used here is that it would have been 
about 11.5 points higher had it been made 
by an A student. 

The fact that the differences among 
the groups in the rating of the personalities 
of the instructors were small provides some 
evidence that a generalized halo of popu- 
larity did not dominate the student rat- 
ings. Although ratings of teaching skills 
and abilities were significantly related to 
the expected grade in the course, ratings 
of personality were not. This is contrary 
to the conclusions drawn by Royce (1956). 


CoNCLUSIONS 


The following conclusions were drawn 
from these data: 

1. In this sample, student ratings of in- 
structors were biased in the direction of 
the grades which they expected to receive 
in the course. 

2. Most of the student bias in instructor 
rating was directed toward the teaching 
skills and abilities of the instructor. 

3. In general, this student bias did not 
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affect ratings of instructor personality 
variables. The evidence suggested that stu- 
dent rating of an instructor’s teaching 
skill was not a product of a popularity 
halo. 

4. Students who expected to receive C’s 
seemed to be generally less discriminating 
in their appraisal of their instructors than 
students who expected to receive B’s or 
A’s. Their relatively narrow dispersion of 
scores suggested that their rating behavior 
conformed to a culturally determined 
norm. 
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ENGINEERING INTERESTS* 
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The serial investigations of Roe (195la, 
1951b, 1953) imply that motivation plays 
a vital role in high-level scientific achieve- 
ment. Terman’s monograph (1954) on 
gifted scientists and nonscientists contains 
an affirmation and some specific evidence 
to the effect that interest measures are 
among the better group discriminators. 
Each investigator has reference to data 
regarding the genesis of critical scientific 
or research motivations. 

Since interests do appear to be of vital 
importance in the context of high-level 
achievement, and since relatively little 
is known regarding their origins and de- 
velopment, the present study was designed 
to cast some light on their antecedents 
in one restricted area. Specifically, its 
purpose is to indicate some of the life his- 
tory correlates of measured interest in the 
broad field of engineering and in two of 
its most dissimilar branches—research and 
sales. 


METHOD 


The problem thus formulated was at- 
tacked by correlating responses to a 100- 
item scored life history form with scores 
obtained on the Engineering scale of the 
Strong Vocational Interest Blank, and 
with two profile scales derived therefrom 


* This study is abstracted from G. E. Kul- 
berg’s thesis written in partial fulfillment 
of the requirements for the Master’s degree 
at Iowa State College. 

*The writers wish to acknowledge the 
technical assistance of Leroy Wolins as 
methods advisor, and the financial assistance 
of the Engineering Experiment Station at 
Iowa State College. 


by Dunnette (1957). These latter, hy- 
pothesized to represent the poles in en- 
gineering interests, are for Sales Engineer- 
ing and Pure Research. 


Measuring Devices 

The Strong Vocational Interest Blank 
is well known and requires no comment. 
Literature relating to the development and 
use of the life history has recently been 
summarized by Lathrop (1957); items of 
the present instrument were in multiple 
choice form and of two types. Forty items 
involved alternatives, presumably on a 
continuum, from which only one could be 
chosen by an individual respondent. The 
other 60 items involved dichotomous re- 
sponse options, with a common stem, such 
that several options could be chosen by a 
given respondent. Thus, the total number 
of response options was 348. 


Subjects 


The Ss were mechanical engineering 
freshmen who entered Iowa State College, 
in that curriculum, during the fall of 1957, 
or who transferred into it prior to the 
middle of the quarter. Only 111 of a pos- 
sible 148 were available for inclusion. It 
seems probable that poor attitude and 
inappropriate interests were prominent 
among the reasons for this attrition. If so, 
there may be some restriction in the range 
of interests reported here and, thus, some 
minimizing of the magnitude of interest 
vs. life history relationships. 


Chronology 
Ss completed the life history during 
the regular sequence of freshmen testing 
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and the Strong during a required engineer- 
ing orientation course two months later. 

Product-moment correlations, or their 
equivalent, were subsequently obtained 
between each item of the life history and 
score on each of the three scales of the 
Vocational Interest Blank. Dichotomous 
items which did not have at least 6% of 
the cases in the smaller response (or non- 
response) category were dropped from 
the computations but were nevertheless 
utilized to describe the groups. 


Item Selection 


Items from the life history were deemed 
related to engineering interests if they cor- 
related at or above the 5% level (r = 0.18) 
with one of the three interest scales, or 
if they correlated 0.17 with one of these 
scales, had small variance and “made 
sense” in themselves and in relationship 
to other significant items. (item variance 
was thus taken into account because of its 
effect on the magnitude of item-scale cor- 
relations.) 

Since this study did not involve cross- 
validation in the conventional sense, it 
is axiomatic that some of the correlations 
reported are attributable to chance. Bro- 
zek and Tiede’s formula (1952) was uti- 
lized to lend assurance that chance alone 
could not account for them. The fact that 
allegedly opposing interests (research vs. 
sales) are, in fact, frequently accompanied 
by quite opposite life history antecedents 
offers assurance of another sort, since the 
totality of such an outcome can hardly be 
attributed to chance. 


RESULTS 


As previously noted, high consensus, 
dichotomous options, elected by 94% or 
more of the Ss, were used only to charac- 
terize or describe the respondents. Thus, 
they may be typified as follows: (a) they 
were single, had siblings, were reared by 
both parents, had a hobby; (5) did not 
enjoy lectures in high school; (c) expected 


college to be more difficult, were not “life 
of the party” personalities; (d) were per- 
mitted to go out over week-ends; (e) 
worked during high school; (f) had early 
(indirect) sex information; (g) and did 
not feel that they would enter manage- 
ment. 

In similar fashion, the parents of the 
respondents are typified as follows: (a) 
they owned or rented a home; (6) owned 
a car; (c) lived together; (d) either 
wanted their son to enter a profession or 
had no preferences; (e) and, they were 
engineers, managers, farmers, or skilled 
tradesmen, or were in private business; (f) 
they were not doctors, teachers, lawyers, 
salesmen or unskilled laborers. 

Following identification of the items in- 
volving “thin splits” each of the remaining 
252 response options were correlated with 
score on each of the three interest scales. 
This yielded a total of 756 correlations 
ranging from +.44 to —0.35. Eighteen of 
these were significant at the .01 level, and 
64 were significant at the .05 level. Utiliz- 
ing Brozek and Tiede’s formula (1952), 
the probability of obtaining either result 
by chance is less than .0001. 

The items themselves, the response 
options and their correlations with the 
given interest scale, or scales, appear in 
the tables which follow. Table 1 contains 
all the items correlated with the Engineer- 
ing Interest scale, plus options common 
to one or both of the other two scales, as 
indicated. Table 2 contains all remaining 
items correlated with the Pure Research 
Interest scale, plus options common to the 
Sales Engineering scale; and Table 3 con- 
tains only the items correlated with the 
Sales Engineering Interest scale alone. An 
attempt has also been made to arrange 
the items chronologically, although in the 
case of the sales engineers it seemed neces- 
sary to utilize a general category for items 
which appeared to spread over the entire 
range, and to assign arbitrarily items 
which might have been allocated to either 
of several positions. 
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Lire History Irems CoRRELATED WITH ENGINEERING INTEREST, PLUs Options COMMON 
To Pure RESEARCH AND/OR SALES ENGINEERING INTEREST 


Item 


Correlation 


E* 


PR* 


SE* 


Elementary 
During my youth when teams were being chosen for games, 
I was usually picked: 
near the 
near the first 
I was usually the one doing the choosing 
High School 
When you were in school (grade or high) where did you 
and your friends most often get together? 
On the street corner 
At your house 
At a friend’s home 
What grades did you make in science courses in high) 
school? 
(Coded 1-4, D’s to A’s) 
What were your main subjects in high school? 
Business or Commercial 
Which were most difficult? 
Commercial courses, bookkeeping, typing } 
Which were easiest? 
History, economics, civics 
Natural Science, Biology, Zoology 
Which type of courses did you most enjoy? 
Discussion 
Natural Science, Biology, Zoology ] 
Which of the following offices did you hold at any time in 
high school? 
jo hairman of an important student committee or club 
Be Never held any 
Ee When you were 15 years of age, how many living brothers 
and sisters did you have? 
(Coded 1 to 5, no brothers or sisters vs. 4 or more.) 
When did you first consider entering college? 
In junior high 
Have always planned to come 
B After (H.S.) graduation, but not in service 
i Contemporary and future 
What are your present hobbies? 
Music 
Which one of the following has caused you the most diffi- 
culty in the past 6 months? 
Nothing special 
When some difficult problem is bothering you with whom 
do you usually talk it over? 
o one 
Father 
What sort of work do you like? 
With things 
With ideas 
What type job do you feel you will eventually take? 


Research 
= What sort of work do you like? 
; With people 
How do you feel about jobs requiring routine operations, 
calculations, etc.? 
Rather enjoy once I get hang of it 
Dislike them but would take one if well paid 


—.19 


—.19 


—.18 


— .18 


*E = Engineering; PR = Pure Research; SE = Sales Engineering. 


= = 
P 
.19 
| —.24 .27 H 
— .20 
.22 —.29 
| 
.23 
.20 ' 
| —.18 Co 
| 
.26 — .23 
| I 
| —.24 32 
| 20 | 
| —.27 
| 
. sen 
| ing 
firs 
— .20 not 
son. 
—.21 me! 
sup 
— .33 and 
-19 cess 
32 —.35 tha 
.21 —.21 Thi 
plar 
Sales 
— .26 enjo 
—.38 43 
tere: 
havi 
} 


ANTECEDENTS OF ENGINEERING INTERESTS 


TABLE 2 


Lire History Irems CorrELATED ONLY wiTtH PuRE RESEARCH INTEREST PLUS 
Options ComMoN TO SALES ENGINEERING INTEREST 


Item 


Correlation 


PR 


SE 


Preschool 
At what age was your father when you were born? 
(Coded 1-4, about 20 vs. about 35) 
High School 
ow much money did your family have while you were going 
to high school? 
About as much as my classmates 
Do not know, or had not considered it 
To which of the following recreational activities hove you de- 
voted the most time in the past 5 years? 
Music, art, dramatics 
Who was the most influential in your decision to go to college? 
Another adult, teacher, minister 
Friends 
About how often have you changed your mind about your fu- 
ture vocational plans since entering high school? 
(Coded 1-4, have not changed vs. too many times to remember) 
Have still not decided 
Contemporary 
Parental occupation: 
Manager or supervisor 
Private business 
Where do you belong in a list of 100 typical people in the kind of 
job you can do best? 
(Coded 1-4, lowest one-third vs. best 5%) 
How good do you think you are, or could be, as a supervisor? 


— .24 


(Coded 1-4, in the lowest one-half vs. in the top 5%) -. 


Don’t know 


29 34 
-20 


Discussion 


To summarize the tabular results pre- 
sented, the possessor of typical engineer- 
ing interests appears somewhat as follows: 
first, he has a history of painful and/or 
not completely necessary or successful per- 
sonal-social contacts and of some adjust- 
ment problems. Second, he has a history of 
superior achievement in science courses 
and of more enjoyment of and more suc- 
cess in quantitative and utilitarian courses 
than in linguistic and social studies courses. 
Third, he has a history of long career 
planning, of liking to work with things 
and ideas as opposed to people, and of 
enjoying creative work and disliking rou- 
tine. 

This pattern of typical engineering in- 
terests seems intensified in the case of Ss 
having the interests of research engineers. 


They appear somewhat unique in being 
more clearly from middle-class homes, be- 
ing intellectually independent, having a 
considerable breadth of academic curiosity 
and success, and being somewhat lacking 
in self-confidence in general and in con- 
fidence in their supervisory ability in par- 
ticular. 

These first two patterns are virtually 
completely reversed in the instance of Ss 
having the interests of sales engineers. 
Indeed, the relationships of many identical 
life history items to scores on this scale are 
precisely the opposite of those noted 
earlier. Here the picture is one of success 
in dealing with people, of liking linguistic 
and nonscience courses, and of enjoying 
people more than things and ideas. 

Among the limitations of this investiga- 
tion are the following: First, the broad 
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TABLE 3 
Lire History Irems CorRELATED ONLY WITH SALES ENGINEERING INTEREST 
Correlation 
Item 
SE 
High School 
How would you classify yourself as a student in high school? 
(Coded 1-5, poor to considerably above average) 17 
Which of the science courses did you take while in high school? 
Physics 
Which of the math courses did you take in high school? 
Advanced algebra, Trigonometry 
(at least part of a semester) 21 
What school projects or activities did you participate in while in 
high school other than athletics? 
Student council, 
Class offices .25 
How many elective offices did you hold while in high school? 
(Coded 1-5, none to 11 or more) -21 
What size school (high) did you attend? 
(Coded 1-5, rural area vs. over 25,000) 21 
During your last two years in high school, about how many hours a 
week did you spend on athletics? 
(Coded 1-5, none vs. 15 or more) -23 
As you grew up, how did you feel about high school? 
(Coded 1-5, cordially disliked vs. liked it very much) -41 
Where did most of your spending money come from during the years 
you were in high school? 
Partly allowance, partly earnings -22 
Contemporary and future 
How many very close friends do you have today? 
(Coded 1-5, none to 8+) .26 
How often do young people, outside of your immediate family, come to 
you for advice? 
et (Coded 1-5, never to constantly) 17 
7 If single, how often do you date, on the average? 
&, (Coded 1-5, do not date vs. more than 2 a week) .22 
r Do you consider yourself a relaxed person? 
Yes abe 
What type job do you feel you will eventually take? 
Sales 
Contemporary and future 
How close to Iowa State College is your home? 
(Coded 1-5, less than 20 miles to 200 or more) .25 
General 
About how large was the town in which you grew up? 
(Coded 1-5, rural area to over 25, am 
Was your mother employed and away from home, at least part time 
while you were growing up? 
(Coded 1-5, yes, she started before I was 6 years old vs. no.) -28 
How much influence did your parents exert over your choice of friends? 
Objected to a few -24 
How often did you feel that you agreed with your parents concerning 
things in general? 
ss (Coded 1-5, we never disagreed vs. we hardly ever agreed.) 28 


patterns of antecedents of engineering in- 
terests which have been traced here may 
not be peculiar to engineering. Further 
studies are needed to determine this; al- 
4 though the fact that such large differences 


exist between (research vs. sales) sub- 
groups within the occupation suggests that 
measurable differences between occupa- 
tions also exist. Second, the intercorrela- 
tions between the various life history 


it 


be 
er 
er 
th 
th 
fel 
ba 
we 
shi 
stu 
set 
the 
the 
of 
be 
the 
mu 
rela 
0 
who 
gine 
of a 
fact 
thar 
This 


ANTECEDENTS OF ENGINEERING INTERESTS 31 


items are not known. For example, it may 
be that possessors of a marked interest in 
engineering are not, typically, social lead- 
ers because, like many superior students, 
they are educationally accelerated and 
thus somewhat less mature than their 
fellows. Third, sweeping generalizations 
based upon so circumscribed a sample 
would be clearly unwarranted. Fourth, it 
should of course be recognized that this 
study involves only the correlation of one 
set of questionnaire results with another; 
the inherent weaknesses of the method are 
therefore multiplied. Fifth, in the absence 
of a conventional cross-validation, it may 
be assumed that the broad pattern of 
these results is correctly drawn, but it 
must also be recognized that some specific 
relationships are attributable to “chance.” 


SuMMARY AND CONCLUSION 


Overall, the subjects of this investigation 
who exhibited a marked interest in en- 
gineering were young men with a history 
of academic superiority and of more satis- 
factory experiences with things and ideas 
than with people and social situations. 
This pattern was intensified in the case 


of research engineering interests and re- 
versed in the case of sales engineering 
interests. 
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CONCEPT ACQUISITION AS A FUNCTION OF 
DIFFERING SCHEDULES AND DELAYS 
OF REINFORCEMENT 


GILBERT SAX 
University of Hawai 


One of the major responsibilities facing 
the educational psychologist is that of dis- 
covering the conditions under which chil- 
dren learn most effectively and economi- 
cally. Few studies by learning theorists 
have been directed to the investigation of 
the effect of different delays and schedules 
of reinforcement on the acquisition and 
retention of complex skills. The present 
study attempts to provide some experi- 
mental data which may contribute to an 
understanding of the role of reinforcement 
in a complex learning task using high 
school students as subjects. 

The questions raised by this investiga- 
tion are: 1. Do subjects who are exposed 
to 100% reinforcement learn complex 
tasks more rapidly than do subjects ex- 
posed to 50% aperiodic reinforcement? 2. 
Do subjects exposed to differing delays of 
reinforcement (no delay, 10-min., 20-min., 
and 40-min. delays) demonstrate statisti- 
cally significant differences in perform- 
ance? 3. Does 100% reinforcement lead to 
greater retention than does 50% aperiodic 
reinforcement? 4. Is there any significant 
interaction effects between different sched- 
ules and delays of reinforcement? 

Experimental evidence regarding the 
differential effects of partial (i.e., less than 
one reinforcement per correct response) 
versus continuous reinforcement (one re- 
inforcement for each correct response) 
has yielded somewhat contradictory re- 
sults. In a review of the literature on the 
effects of partial versus continuous rein- 
forcement on acquisition trials, Jenkins 
and Stanley (1950) concluded that many 
of the studies showed superiority of con- 
tinuous over partial schedules of rein- 


forcement. However, some studies (Hum- 
phreys, 1939; Sheffield, 1949; Denny, 
1946; Kapos, Mech, & Fox, 1957) yielded 
statistically insignificant results. 

The results of animal studies concerned 
with the effectiveness of a delay of rein- 
forcement on learning have been quite 
contradictory, some having indicated that 
reinforcement latency is negatively cor- 
related with measures of habit strength 
(Perin, 1943), whereas others have yielded 
statistically insignificant _ relationships 
(Warden & Haas, 1927; Watson, 1917). 
When human beings are employed as sub- 
jects, the conclusions appear even more 
complex. For example, one investigator 
(Stephens, 1931) found that a delay of 


reinforcement of just two seconds de- 
creased the efficiency of learning whereas | 
others (McGuigan, 1959) found that a | 
delay up to 15 seconds in the presentation | 
of a reinforcement did not decrease the 
number of errors committed over those | 
found for an immediately reinforced 
group. One study (Forlano, 1936) pre- 
sented evidence that learning is aided by - 
delaying reinforcement. 


METHOD 


The design of this research has been to 
equate eight separate groups of high 
school students (total N = 120) on IQ 
(California Test of Mental Maturity), 
CA, and sex. Each group was given the 
task of learning Chinese symbols by the 
paired-associates method (each symbol 
was associated with a nonsense syllable) 
under either 50 or 100% schedules of re- 
inforcement and delays of reinforcement 
of zero, 10, 20, or 40 minutes. 
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CONCEPT ACQUISITION AND REINFORCEMENT SCHEDULES 


Using a technique employed by Hull 
(1920), a series of six Chinese characters 
or roots were prepared. For each of these 
six roots 6 idiographs containing each of 
these roots plus irrelevant cues were care- 
fully drawn on ozalid paper to make a 
complete set of 36 idiographs. These idio- 
graphs were then pasted in the center of 
a 3 X 5 inch white card. 

Associated with each of the six Chinese 
roots was a nonsense syllable equated as 
to association value (Glaze, 1928) at the 
20% recognition level. The names of the 
syllables chosen were BEJ, FUP, GEB, HIF, 
RUx, and Ter. Each card containing an 
idiograph was then given the name of its 
root, and this name was printed on the 
back lower left corner of each card where 
it could readily be seen by the experi- 
menters. 

A preliminary informal pilot study was 
conducted in an effort to discover the op- 
timal number of cards (concepts) to be 
used in the experiment itself. It was found 
that the use of all 36 cards was too diffi- 
cult a task for high school students and 
that the use of three radicals (BEJ, FUP, 
and HIF) with five idiographs of each 
(yielding a total of 15 cards) was most 
satisfactory in terms of the difficulty of 


| the task. 


A reinforcement apparatus which made 
it possible for the experimenter to present 
one concept card to the subject at a time 
and which also permitted him to reinforce 
correct responses at his discretion was 
constructed. Operationally, a reinforcer 
may be defined as any stimulus which can 
increase the strength of a response. In the 
present experiment the reinforcement is 
in the form of a green light which is visible 
to the subject and under the control of 
the experimenter. Inasmuch as this stimu- 
lus is associated with an increase in habit 
strength (i.e., with an increase in the num- 
ber of correct responses evoked on suc- 
cessive trials) the green light functions as 
a reinforcer. 
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Four research assistants were employed 
in collecting data. On initial contact with 
the student, the following instructions 
were read: 


(For All Pupils) 


I am going to show you some Chinese 
symbols. Each of these symbols will be 
given an odd sounding name. These names 
have been printed on the left side of the 
box [point] to help you remember them. 
Some of the Chinese symbols will have the 
same odd sounding names. 

You can tell whether or not you have 
given the correct odd sounding name with 
the Chinese symbol by looking at this light 
[point]. If the light goes on, like this [turn 
on light], it means you definitely have given 
the right odd sounding name. If the light 
does not go on, however, you may still have 
been right or you may have been wrong. 


(For Pupils Having Delay Periods) 

Before you can find out whether or not 
the green light will go on, you will have to 
wait a while, that is, after you go through 
all of the symbols on the cards, you will be 
asked to return to your seat and later we 
will call you back here. You will then have 
a chance to see on which cards the light 
will go on. 


(For All Pupils) 


Before you get a chance to check your 
memory, we will first go through all of the 
Chinese symbols and I will tell you what 
the odd sounding name is that belongs with 
each symbol. I can only give you the an- 
swers this one time. From then on, you will 
have to check the light to see how well you 
are doing. 


Each assistant then thoroughly shuffled 
his package of 15 Chinese symbols and 
presented each one of them to the student 
for approximately two seconds each. As 
each card was presented, the assistant 
carefully pronounced the name of the non- 
sense syllable which was associated with 
each card. The first acquisition trial be- 
gan as soon as the subject had been shown 
all 15 cards. A special tally sheet was pre- 
pared for each student to help assistants 
keep a record of the schedule and delay 
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TABLE 1 


MEANS AND STANDARD DEVIATIONS FOR 
ACQUISITION TRIALS 


Percentage Delay of 
of Rein- Rein- Mean 
forcement forcement 


S 


50 0 6.00 +1.11 4.18 
50 10 8.33 + 1.51 5.64 
50 20 8.80 + 1.07 4.02 
50 40 10.07 + 1.72 6.44 
100 0 9.20+1.02 3.82 
100 10 8.73 + .87 3.25 
100 20 9.60 +1.21 4.51 
100 40 12.13 + 1.51 5.65 
TABLE 2 


ANALYSIS OF VARIANCE EMPLOYING TRIALS 
to Reacw a LEARNING CRITERION AS 
THE DEPENDENT VARIABLE 


(N = 120) 
Source of Sum of af Variance); p 
Variation Squares Estimate 
Reinforce- 81.7650; 1 |81.6750/3.40 


ment sched- 


ule 
Delay periods | 205.4916) 3 |68.4972/2.85* 
Interaction 37.4251 3 12.4750) .52 
Within cells |2692.5333) 112 |24.0404 


Total 2017 .1250) 119 


* Significant at .05 level of confidence. 


of reinforcement as well as the number of 
correct responses evoked on each trial. 
Each assistant was given a table of ran- 
dom numbers which was to be used with 
students having 50% aperiodic reinforce- 
ment.’ 

Each subject was given one acquisition 
trial per day whether or not there was a 
delay in reinforcement or not, and this 


1A 50% aperiodic reinforcement occurs 
every other time a correct response is 
evoked on the average. By using a table of 
random numbers an experimenter can rein- 
force subjects whenever the correct response 
coincides with an even-numbered digit on 
the table. 


was continued until all of the responses 
for each of the 15 concept cards were 
learned correctly. The green light func- 
tioned to confirm to the subject that his 
response to the Chinese symbol was cor- 
rect. Two weeks from the time the stu- 
dent received a perfect series of associa- 
tions, he was called back without warning 
and was again presented with all 15 cards 
as a retention check. 


FInDINGs 


An analysis of variance design was em- 
ployed to check on the significance of the 
major hypotheses. Since neither delay pe- 
riods nor the reinforcement schedules 
were chosen at random, a fixed constants 
analysis of variance model was utilized. 

An examination of Table 1 reveals that 
as reinforcement latency increases there is 
a tendency for the number of trials needed 
to reach the learning criterion (15 correct 
associations between nonsense syllables 
and Chinese symbols) to increase. Bart- 
lett’s test for homogeneity of variance 
yielded an insignificant chi square of 8.27, 
thus fulfilling one of the assumptions on 
which the analysis of variance is based. 
With the number of trials needed to reach 
the criterion of learning as the measure of 
habit strength, an F ratio of 2.85 was 
found for delay periods (see Table 2). 
With degrees of freedom equal to 3 and 
112, this ratio is significant at the .05 
level of confidence. In an effort to find 
which means were yielding significant dif- 
ferences, Duncan’s multiple range test for 
comparing individual means (Duncan, 
1955) was employed. The only significant 
difference between the means was for the 
two extreme groups (50%-zero delay and 
100%—40-min. delay). However, schedule 
of reinforcement apparently is unrelated 
to number of acquisition trials needed to 
reach a criterion of learning. Interaction 
effects were not statistically significant. 
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TABLE 3 
MEANS AND STANDARD DEVIATIONS FOR 
THE NUMBER OF CoRRECT RESPONSES 
ON A RETENTION TRIAL 


Percentage Delay 


of Rein- of Rein- Mean SD 
forcement forcement 
50 0 12.47 + .65 2.42 
50 10 13.13 + .61 2.30 
50 20 12.40 + .65 2.94 
50 40 12.27 + .75 2.80 
100 0 13.07 + .52 1.94 
100 10 13.13 + .71 2.65 
100 20 13.27 + .57 2.14 
100 40 13.73 + .49 1.84 
TABLE 4 


ANALYSIS OF VARIANCE EMPLOYING THE 
NuMBER CORRECT ON A RETENTION 
TRIAL AS THE DEPENDENT VARIABLE 


(N = 120) 
Vari- 

Source of Variation |_ ~ af Eats. F 

q mate 
Reinforcement | 16.13 1 {16.13 |2.54 
schedule 
Delay periods 2.47) 3 -823) .1298 
Interaction 8.34 3 | 2.78 | .4384 
Within cells 710.53} 112 | 6.34 

Total 737.47} 119 


When retention was used as the meas- 
ure of habit strength, there were no sta- 
tistically significant F ratios with regard 
to latency, schedule of reinforcement, nor 
interaction effects (see Tables 3 and 4). 


SuMMARY 


Eight equated groups of high school 
students were presented the task of ab- 
stracting roots from complex Chinese 
characters under different schedules and 
delays of reinforcement. Habit strength 
was measured as a function of the number 
of trials needed to reach a criterion of 
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learning and number of correct responses 
on a retention check. 

A fixed constants analysis of variance 
model indicated that as the latency in the 
presentation of a reinforcement is in- 
creased there is a significant increase in 
the number of trials needed to reach a 
learning criterion. The analysis of variance 
failed to refute the null hypothesis when 
retention was employed as the dependent 
variable or when differing schedules of 
reinforcement were used with acquisition 
trials as the dependent variable. 
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EFFECTS OF GROUP EXPERIENCE ON INDIVIDUAL 
PROBLEM SOLVING 


BRYCE B. HUDGINS 
Graduate Institute of Education, Washington University 


A number of investigators (Gurnee, 
1937; Klugman, 1944; Perlmutter & de 
Montmollin, 1952; Taylor & Faust, 1952) 
have examined the relative effectiveness 
of problem solving by groups and by in- 
dividuals. In general, they have found that 
groups furnish more eorrect solutions to 
problems than comparable subjects do 
working as individuals. The present in- 
quiry continues in this tradition, and at- 
tempts to extend knowledge in the area 
by providing experimental answers to two 
questions related to the problem solving 
behavior of elementary school children. 
First, do children working together in 
groups learn techniques of problem solv- 
ing which they can apply later in similar 
situations, and, secondly, does interaction, 
as herein defined, contribute to the su- 
periority of group problem solving? A 
casual inspection of elementary school 
principles of teaching texts would suggest 
that this transfer and the conditions under 
which it occurs are demonstrated facts 
rather than unanswered problems. 

Answers to these questions hinged on 
the assumption that groups of children 
would be more successful in solving prob- 
lems than their counterparts working in- 
dividually. This result had been so well 
demonstrated in the past that there 
seemed little reason to doubt that it could 
be replicated in a school situation. 

Additional significance of the study lies 
in the use of “natural groups.” The use 
of ad hoc groups has been criticized in a 
survey of investigations of group and in- 
dividual performance. 


A common and dangerous practice is to 
generalize the principles valid for ad hoc 
groups to traditioned groups. The ad hoc 
group is treated as a microscopic model of 
the traditioned group. This might be true, 
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but has not been experimentally validated. 
It is equally possible that ad hoc and tra- 
ditioned groups behave in accordance with 
their individual principles (Lorge, Fox, Da- 
vitz, & Brenner, 1958). 

The groups used in this study were ad 
hoc in the sense that they were organized 
for purposes of the investigation. It seems 
to the writer that what constitutes a tra- 
ditioned group depends upon the context 
in which the group is found. It can be 
argued that groups which operate for 
three consecutive days, as in the present 
study, approximate traditioned groups as 
they exist in the classroom. The analogy 
here is between the experimental groups 
and others which are formed for a spe- 
cific activity within the classroom. 


AND RATIONALE 


Three hypotheses were formulated to 
provide a basis for answering the ques- 
tions asked above: 

1. The first hypothesis was that prob- 
lem solving experience in a group im- 
proves individual ability more than does 
individual experience. 

It was hypothesized that when subjects 
(Ss) who had worked on arithmetic prob- 
lem as members of a group were tested 
individually, their mean score would be 
significantly higher than the mean of Ss 
who had worked individually throughout 
the experiment. This answers the first 
question above, concerning the carry-over 
from the group situation to a subsequent 
individual one. 

2. The second hypothesis was that in- 
dividual ability to solve arithmetic prob- 
lems improves as a result of specifying 
the steps involved in arriving at solution. 

Specification consisted of providing 
written answers to a series of questions 
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which were intended to lead Ss toward 
problem solution. There were four ques- 
tions which specification subjects had to 
answer in connection with the solution of 
each problem: 


. What are you asked to find? 

. What information are you given that 
will help you find the answer? 

. What do you have to do to find the 
answer? 

. What is the answer? 


Ne 


It was predicted that the mean score 
of Ss who had worked under the condi- 
tion of specification would be significantly 
higher than the mean of Ss who had not 
used specification. 

Underlying this hypothesis was the rea- 
soning that disagreement among group 
members about a solution initiates a re- 
view process during which the attention 
of individual members is directed to the 
various critical steps in problem solution. 
The group’s contribution to successful 
problem solving, then, lies in “instructing” 
the participants in proper problem solving 
procedure. If this is true, the student 
working alone who is required to specify 
the steps by which progress is made to- 
ward problem solution will improve much 
as if he were exposed to the influence of 
the group. Thus, the group influence may 
be an artifact, seemingly important, but 
only because it invokes a process which 
one ordinarily would not use, but would 
be capable of using, in isolation. 

3. A final hypothesis was that the im- 
provement of problem solving ability as 
a result of group experience stems from 
the relevancy of intragroup communica- 
tion to the processes involved in problem 
solution. 

That is, students tested individually 
following a period of time in which they 
had worked as members of a group using 
specification would solve significantly 
more problems than subjects who worked 
initially in nonspecification groups. By 
systematizing the “instruction” process 
in the group situation, presumably even 
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greater gains in individual problem solv- 
ing success will be realized. 

In short, is there carry-over in the form 
of higher individual performance as a 
consequence of the group experience, and 
does a structuring of problem solving pro- 
cedures account for a portion of the varia- 
tion in pupil performance? 


METHOD 


Sample 


The Ss of the investigation were 128 
fifth-grade students selected in equal num- 
bers from each of four public schools in 
the city of St. Louis. 


Controls 


A measure of each S’s general mental 
ability and arithmetic problem solving 
ability was made immediately prior to the 
experiment. The general mental ability 
test used was the California Test of Men- 
tal Maturity, Short form. Arithmetic 
ability was measured by the California 
Arithmetic Test, Elementary, Grades 
4-5-6, Form W. 

The 32 Ss in each classroom were 
matched by fours on the basis of their 
general ability and arithmetic test scores, 
and assigned to one of four experimental 
groups. The assignment of the 8 Ss in each 
group to an experimental condition was 
done by reference to a table of random 
numbers. Following the final assignment 
there was no significant difference in either 
general mental ability or arithmetic ability 
among the groups prior to the experiment. 

During the experiment, the groups from 
two of the classes were taken to a room 
other than their regular classroom. In the 
other two classes, Ss working individually 
were taken to another room, while the 
groups remained in their homeroom. This 
was done in order that the novelty of a 


new working environment would not exer-_ 


cise a systematic influence on any one of 
the experimental conditions. 
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Tasks 


The arithmetic problems from Forms 
J, K, L, and M of the Stanford Achieve- 
ment Test, Intermediate, were used as 
experimental materials. The following are 
2 problems out of the total 120 which Ss 
were asked to solve. 


Bill jumped 13 feet, 5 inches on Tuesday. 
On Thursday he jumped 11 feet, 9 inches. 
How much farther did he jump on Tuesday 
than on Thursday? 

The butcher says to cook a turkey 20 
minutes for each pound. At what hour 
should a 15 pound turkey be started in 
order to be done at twelve o’clock noon? 


Procedures, Phase 1 


The first phase consisted of three con- 
secutive days of problem solving using 
Forms J, K, and L of the Stanford. The 
128 pupils worked as follows: Thirty-two 
pupils (called A Ss) worked in subgroups 
of four students. Each subgroup had to 
agree on a single answer to each question 
in the specifications. 

Another 32 pupils (B Ss) also worked 
in four member groups. Within each 
group, members were free to develop their 
own methods for solving the problems. 
The only restriction imposed upon them 
was that the group must arrive at one 
answer to each problem. 

Half of the 64 pupils working individ- 
ually (C Ss) used the method of specifica- 
tion. The other half (D Ss) were simply 
instructed to solve the problems and to 
record each solution in the appropriate 
space on the problem sheets. 


Procedures, Phase 2 


This portion of the experiment consisted 
of the 128 students solving individually 
the 30 problems in Form M of the Stan- 
ford. To ascertain the possible effects of 
differential retention, all the Ss from one 
classroom (i.e., one-fourth of the total 
sample) were tested on each of the fol- 
lowing days after the completion of Phase 


1—the first, second, fifth, and twelfth 
day. In this way, one-fourth of the A, B, 
C, and D Ss were tested on each day of 
Phase 2. 


REsULTs 


Phase 1 


Throughout the three days of Phase 1, 
Ss who worked in groups made higher 
scores than Ss working individually. On 
the first day the mean score of Ss working 
in groups (A and B) was 18.82; that for 
Ss working individually (C and D) was 
12.80. The mean score for individuals rose 
on the second day to 13.13, while the 
groups’ mean was only 17.69. On the final 
day, group Ss had a mean of 20.81 correct 
responses as compared with 14.91 for in- 
dividuals. The difference for each of the 
three days of Phase 1 was significant be- 
yond the .01 level. If these differences 
had not occurred, there would have been 
no basis for testing the hypotheses in 
Phase 2. Any reason for expecting that 
transfer might result from the group ex- 
perience, or that specification might be 
useful as an explanatory concept, would 
have been lacking. It is for these reasons 
that Phase 1, which simply demonstrated 
an already well established finding, was 
an essential part of the experiment. It 
confirmed the condition upon which the 
appropriateness of tests of the three hy- 
potheses depended. 

The mean of the Ss using specification 
(Conditions A and C) was 13.88 for the 
first day. The mean of the B and D Ss 
(conditions of nonspecification) for the 
same day was 17.74. This difference was 
significant beyond the .05 level. On the 
second and third days of the first phase, 
there was no significant difference be- 
tween the specification and nonspecifica- 
tion conditions. However, the B Ss (who 
worked in groups without specification) 
achieved higher scores during Phase 1 
than Ss working under any of the other 
three experimental conditions. 
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TABLE 1 
MEAN ScorE ON ARITHMETIC PROBLEMS 
ror Eacu PuHase 1 EXPERIMENTAL 
ConDITION AND Eacu Day or PHASE 2 


Day on which Phase 2 Was 
Administered 


Phase 1 
Experimental 
ndition 1 2 5 12 
(N =| (N =| (N =| (N =| Mean 
32) 32) 32) 32) 


A: Groups with|15. 25/17 .25)10.75)15.25)14.63 
specification 

B: Groups 
without 
specification 

C: Individuals/16.25)14 
with speci- 
fication 

D: 
without 
specification 


Mean 17.00/16 .75)13 .57|13 .75)15.27 


Phase 2 


Table 1 gives the mean scores for Phase 
2 of Ss who had worked under each of 
the four experimental conditions, and the 
mean of each class which received Phase 
2 on a given day, respectively. As revealed 
by Table 2, none of the differences among 
Ss in Phase 2 was significant. 


TABLE 2 


Summary TABLE oF ANALYSIS OF VARIANCE 
or PHasE 2 Scores 


Source df PF 


X: Groups versus 1 2.53) .09)>.05 
individuals 

Y: Specification ver-| 1 | 19.53) .70)/>.05 
sus nonspecifica- 
tion 


Z: Retention groups} 3 |111.03)/3.99)>.05 
XY: Interaction 1 | 19.54) .70)/>.05 
XZ: Interaction 3 | 48.28)1.73)>.05 
YZ: Interaction 3 | 19.87) .71|>.05 
XYZ: Interaction 3 | 27.84) .89)>.05 
Within 112 | 31.31 


Total 127 
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These findings indicated that, although 
groups of students working cooperatively 
solve more problems than comparable 
students working alone, there is no sig- 
nificant improvement in the problem 
solving performance of the former Ss be- 
cause of this group experience. Conse- 
quently, the first hypothesis was rejected. 
Nor were the other two hypotheses sup- 
ported; that is, practice in specifying the 
steps used in solving a problem did not 
improve performance any more than in 
the case where such specification was not 
made. This was true whether specification 
was used by individuals or by small 


groups. 
Discussion 


One problem undertaken by this in- 
vestigation was an attempt to offer a valid 
explanation of the superiority of the group 
over individual problem solving activity. 
It was hypothesized that this superiority 
must somehow grow out of the interaction 
among members working together in the 
group. 

The results of the experiment are clearly 
opposed to the acceptance of such an hy- 
pothesis. However, it must be remembered 
that the interaction used in this investiga- 
tion was of a particular type which has 
been designated specification. It cannot be 
said with certainty that interaction per se 
does not affect the quality of the group 
product. It is possible that, in another 
form, interaction may contribute to the 
group superiority. 

For example, two interaction patterns 
were observed in the nonspecification 
groups during Phase 1. In some of the 
groups there was a tendency for one S to 
determine the answer and to communicate 
it to the other group members. If this 
person had status as a class leader, his 
solutions were accepted unquestioningly 
by the other group members. If he did 
not have such status, the correctness of his 
solutions had to be demonstrated before 
they were accepted. 
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The second pattern was a more coopera- 
tive one which approximated the pattern 
of the specification groups except for one 
difference. In these groups each S read the 
problem and solved it independently. The 
answers were then compared. If all the 
answers were identical, the solution was 
accepted; but if there was disagreement, 
one person usually took the initiative to 
demonstrate the appropriateness of the 
solution to the deviant member or mem- 
bers. 

A point of interest arose from the way 
in which these solutions were determined. 
Suppose the problem under consideration 
to be the following: “Our team scored 16 
points in the first game, 6 points in the 
second, and 14 in the third. How many 
points did we score in all three games?” 
If there was disagreement about the an- 
swer, one person would try to remove the 
confusion. The usual form of this was to 
say, “Sixteen and six are twenty-two and 
fourteen are thirty-six.” Such unarguable 
logic was usually enough to convince the 
deviant member. On rare occasions the 
individual said, ““You have to add to solve 
this problem.” This remark was followed 
by the computation. 

At no time was there any evidence of 
attention being given to the first two 
questions assigned to the specification 
groups. Such specification as occurred was 
related to the questions of deciding upon 
a process appropriate for the solution, and 
of finding the answer itself. No student 
was observed justifying his reason for 
selecting a particular process. Obviously 
when an incorrect process was selected 
and agreed upon, the resulting wrong an- 
swer tended to receive enthusiastic if mis- 
guided support. 

Why did the group Ss fail to make 
higher scores than the C and D Ss on the 
final test? The answer to this question 
seems to lie in understanding how the 
Phase 1 tasks were approached by the 
members of both kinds of groups. Speci- 
fication, which was used by half of the 
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groups in Phase 1, provides a systematic 
means of attacking arithmetic problems. 
It was assumed that the correct answer 
to a problem would be found if Ss fol- 
lowed the prescribed steps and if the ap- 
propriate computational skills were known 
and could be used by them. It was also 
assumed that Ss who used specification in 
Phase 1 would see the applicability of the 
method when they were later confronted 
by similar problems, i.e., in Phase 2. The 
Phase 2 scores of “groups with specifica- 
tion” Ss lead to the conclusion that there 
was no transfer from the group to the 
individual situation of the steps which 
were used in the training period. 

As for members of nonspecification 
groups, it is probable that little if any 
problem solving skill was acquired in the 
training period. Their attention seems to 
have been focused upon accomplishing the 
task at hand with little regard for develop- 
ing skills which would be useful in subse- 
quent cases. 

The importance for transfer of gener- 
alized experience has been demonstrated 
by Judd (1908) and by Hendrickson and 
Schroeder (1941). Furthermore, Kingsley 
and Garry (1957, p. 508) point out “that 
the mere knowledge of the principle will 
not insure transfer of training to new 
situations. Its general applicability must 
be realized, and the learner must be able 
to see the possibility of its application to 
the new situation.” 

This is a significant point for the pres- 
ent discussion. Prior to the experiment, Ss 
were told the nature of the condition under 
which they would work. They were also 
informed that at a later time they would 
be asked to solve additional problems by 
themselves. Little emphasis was placed 
upon this statement, and no attempt was 
made to instruct specification Ss that the 
task given them was one which might help 
them later in solving problems. 

Despite the failure of specification to 
account for the superiority of groups over 

individuals, it is still possible, as indicated 
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above, that interaction is related to this 
superiority. The most reasonable hypoth- 
esis at this point appears to be that 
the problem solving superiority of small 
groups depends upon the efforts of the 
most able member of the group to com- 
municate his knowledge to others, and 
upon the degree to which he achieves ac- 
ceptance of his solutions. If this hypothesis 
proves tenable, transfer from the group to 
the individual situation would not be ex- 
pected to occur. 


SuMMARY 

This study inquired (a) whether specifi- 
cation (citing the steps leading to solu- 
tion) is related to the problem solving 
superiority of small groups over individ- 
uals and (b) whether individual problem 
solving ability improves as a result of 
group experience. 

Subjects were 128 fifth-grade girls and 
boys. The first phase of the study lasted 
three days during which subjects worked 
on sets of arithmetic problems under an 
experimental condition. Half worked as 
group members; half as individuals. Group 
members solved significantly more prob- 
lems than subjects who worked alone. 

In Phase 2, all subjects worked individ- 
ually. No differences were found among 
subjects’ scores in this second phase. It 
was concluded that specification is not re- 
lated to group problem solving effective- 
ness and that group experience does not 
enhance individual problem solving. 
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BIOGRAPHICAL FACTORS ASSOCIATED WITH 
ACADEMIC OVER- AND UNDERACHIEVEMENT' 


O. LEE DUFF ann LAURENCE SIEGEL 
Miami University 


Never before has the need for under- 
standing of the factors which contribute 
to college success been quite as acute as it 
is now. As colleges and universities ap- 
proach maximum enrollment, college ad- 
ministrators are increasingly confronted 
with the problem of selecting potentially 
successful students. Predictive attempts 
based upon measures of ability and past 
performance (high school record) have 
been moderately successful. In spite of 
this, however, sizable numbers of students 
of high measured ability achieve at a lower 
level than predicted, whereas other stu- 
dents of low measured ability sometimes 
demonstrate a high level of achievement. 

A number of recent studies have focused 
upon factors associated with academic 
under- and overachievement in the at- 
tempt to develop more efficient predictors 
of academic success (e.g., McQuary, 1954; 
Parish & Rethlingshafer, 1954; Shaw & 
Brown, 1957). The present study follows 
along this line. The general purpose of this 
investigation was to determine the rela- 
tionship between certain biographical or 
personal history data and academic over- 
and underachievement. 

Research involving the residual achieve- 
ment variance, unaccounted for by ability 
predictors, is beset by two problems. The 
first is semantic in nature and of minor 
consequence. The term “overachiever” 
may be questioned because of the implica- 
tion that the student does more than he is 
capable of doing. The second, and more 
serious problem peculiar to research in this 
area, results from criterion constriction. 


*This research was conducted by the 
senior author in partial fulfillment of the re- 
quirements of the master’s degree in psy- 
chology at Miami University. 


When students are ordered along a con- 
tinuum of under- and overachievement by 
comparing ability and performance level, 
the underachievers tend to be high ability 
students whereas the overachievers tend 
to be low ability students. 

When data comparing underachievers 
and overachievers are presented, these 
data really involve a comparison between 
high and low ability students to a con- 
siderable extent. One solution to this 
methodological fallacy is to treat data 
separately for subgroups by level of abil- 
ity. Thus two of the pairs of groups com- 
pared in the present investigation are high 
ability overachievers vs. high ability un- 
derachievers, and low ability overachievers 
vs. low ability underachievers. 

A variant of the methodological error 
resulting from disregard of the ability 
level of uader- and overachievers occurs 
when this criterion is investigated without 
concern for the sex variable. The data 
obtained from the investigation support 
the desirability of performing separate 
analyses for female overachievers vs. fe- 
male underachievers and for male over- 
achievers vs. male underachievers. 


PROCEDURE 


The Biographical Inventory for Stu- 
dents (BIS)(eg., Siegel: 1956a, 1956b, 
1958) was utilized as an objective measure 
of personal history. This inventory yields 
scores in 10 areas identified as Sports and 
Action, Social Activities, Heterosexual Ac- 
tivities, Religious Activities, Literature, 
Music and Art, Political and Intellectual 
Activities, Socioeconomic Status, Economic 
Independence, Dependence upon the 
Home, and Social Conformity. 

The BIS was administered to 2010 en- 
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tering freshmen at Miami University in 
the fall, 1958. Students whose ages at the 
time of testing exceeded the range of the 
BIS validation and standardization group, 
or who were incoming transfers from other 
colleges or universities, were eliminated 
from the sample. The resultant N for the 
present study was 1454. 

The criterion of under- and overachieve- 
ment was developed by combining scores 
earned on the American Council on Educa- 
tion Psychological Examination (ACE) 
and grade-point average (GPA) after one 
semester into a single index. The raw total 
ACE score for each S was converted to its 
appropriate percentile rank using national 
norms. The GPA for each S was converted 
to its appropriate percentile rank based 
upon the obtained distribution of grade- 
point averages earned by the students in- 
cluded in the study. These two measures 
were then combined into a single criterion 
of over- and underachievement referred 
to as the “decile descrepancy” (DD) by 
the simple process of subtraction in the 
following manner: the GPA decile rank 
was subtracted from the ACE decile rank 
for each student and the difference ex- 
pressed as a numerical value ranging be- 
tween +9 and —9. Negative values are 


TABLE 1 


CRITERION Data BY ABILITY AND 
Sex SuBGROUP 


N | SD |N Mean|é Ratio 
Total cases 1454/2.92)/—1.17 
Low ability Ss 544/2.47|—0.43 12.16* 
High ability Ss 
Male Ss 669/301) —1.74 6.96" 
Female Ss 785|2.75|—0.68) 
Low ability males | 244/2.52) 0.00 3.72* 
Low ability females | 300/2.38)—0.79) 
High ability males | 425/2.82)|—2.73 14.35* 
High ability females} 


*p< .001. 
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indicative of “underachievement” whereas — 
positive values are indicative of “over- | 


achievement.” 

The BIS was scored in the prescribed 
fashion and Pearson product-moment cor- 
relations were computed between BIS sub- 
scales and the criterion of discrepancy be- 
tween measured ability and achievement. 
These correlations were computed sepa- 
rately for males, females, high ability Ss, 
and low ability Ss. 


RESULTs AND Discussion 


The ensuing presentation of findings is 
divided into two sections. The first section 
is concerned with criterion data per se. 
The fundamental issue under consideration 
here is the uniformity or lack of uniformity 


in the utilization of measured academic | 


ability by high ability as opposed to low 
ability students and by males as opposed 
to females. The second section is concerned 
with the relationship between the bio- 
graphical variables and the criterion. 


The Criterion 


The criterion data for each of the sub- 
groups utilized in the study are shown in 
Table 1. The fact that the mean dis- 
crepancy between ability and achievement 
for the total group is —1.17 rather than 
0.00 is attributable to the procedure 
whereby ACE decile conversions were 
based upon national norms, whereas, GPA 
decile conversions were based upon local 
“norms.” 

The dichotomization of students into 
high and low ability subgroups was such 
that ACE total percentile ranks at or 
above the fiftieth percentile were desig- 
nated “high ability”; ranks below the 
fiftieth percentile were designated as “low 
ability.” Even with the contamination 
caused by the inclusion of “average abil- 
ity” students in both the low and high 
ability subgroups; however, it is quite 
apparent that criterion constriction forces 


a greater degree of underachievement to” 


occur in the high ability subgroup. Dis 
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regard of this fact would constitute the 
methodological fallacy described previ- 
ously. 

The data in Table 1 point up the de- 
sirability of treating over- and under- 
achievement separately for subgroups by 
level of ability and by sex. 


The Relationship Between BIS Scores 
and the Criterion 


The correlations between the BIS sub- 
scales and the index of discrepancy be- 
tween ability and achievement are re- 
ported separately by subgroups in Table 
2. Although the magnitude of these cor- 
relations is relatively low, it must be re- 
membered that these values represent 
attempts to account for residual variance 
not already accounted for by the ACE. 

The general configuration of these cor- 
relations is indicative of a negative re- 
lationship between effective utilization of 
academic ability on the one hand and de- 
gree of participation in physical, social, 
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and heterosexual activities on the other. 
Two hypotheses might be developed from 
these data. First, participation in extra- 
curricular activities of this type may re- 
quire that time be diverted from prep- 
aration for academic course work. An 
alternative, but related hypothesis, is that 
participation in these activities and under- 
achievement may both be symptomatic 
of low academic drive. 

Certain interactive effects of ability and 
sex in combination are especially inter- 
esting. High ability female overachievers 
tend more to conform to social require- 
ments, to participate more actively in re- 
ligious activities and less actively in aes- 
thetic activities than do high ability 
female underachievers. Since a parallel pat- 
tern is not apparent for either high ability 
male overachievers or for low ability 
overachievers, these data suggest that 
high ability females may be compelled to 
assume a rather unique role within the 
university community. 


TABLE 2 


CORRELATIONS BETWEEN BIS ScorEs AND THE CRITERION OF DISCREPANCY 
BETWEEN ABILITY AND ACHIEVEMENT 


BIS Subscales 

ACT | soc | HET | RLG | LMA| POL | SES | ECO | DEP | CON 
Total cases .10° —.18¢|—.06* .00 |—.05 .11°—.07> .00 
Low ability —.18% .03 .08 48° .15°%—.02 .08 .00 
High ability Ss — .00 |—.06 |—.04 .05 .00 
Male Ss —.05 |—.02 .22°|— .02 |— .08*|—.01 .00 
Female Ss — .00 .00 .13¢ 
Low ability males .01 |—.13%—.11 | .04| .12|/—.08| .07| .06 
Low ability females .06| .02| .03 |—.03 |—.03/| .03 
High ability males .07 —.04|} .02 |—.04 |—.09 |—.06 |—.01 
High ability females -09*|— -11*|— .15° — .06 -04 |— .07 00; .15° 


NOTE.—The BIS subscales are: ACT—Sports 


and Action; SOC—Social Activities; HET—Heterosexual Ac- 


tivities; RLG—Religious Activities; LMA—Literature, Music and Art; POL—Political and Intellectual Activities; 


SES—Socioeconomic Status; ECO—E 
Conformity. 


ic Ind 


; DEP—Depend upon the Home; CON—Social 


* Correlation significantly different from 0.00 at the .05 level. 
> Correlation significantly different from 0.00 at the .01 level. 
* Correlation significantly different from 0.00 at the .001 level. 
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The strongest obtained correlation in- 
dicates a relationship between over- 
achievement by low ability males and 
their participation in political and intel- 
lectual activities. 


SuMMARY 


The Biographical Inventory for Students 
was administered to 1454 entering fresh- 
men at Miami University, and the sub- 
scores were correlated with an index of 
discrepancy between measured academic 
ability and achievement after one semester 
in residence. The results suggest the fol- 
lowing conclusions: 

1. Criterion constriction is evident at 
both ends of the criterion continuum. 
High ability students have relatively little 
room to demonstrate overachievement, 
whereas low ability students have rela- 
tively little room to demonstrate under- 
achievement. Thus, it is methodologically 
incorrect to study the matter of academic 
under- and overachievement without ref- 
erence to the ability level of the Ss in the 
sample. 

2. Females tend to utilize their meas- 
ured academic ability more effectively 
than do males. 

3. Participation in activities classified 
as sports and action, social and hetero- 
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sexual is quite generally related in inverse 
fashion to the effective utilization of meas- 
ured academic ability. 

4. High ability females who overachieve 
seem to assume a unique role within the 
university community. This group con- 
forms more to societal requirements, par- 
ticipate more actively in religious activi- 
ties, and less actively in aesthetic activities 
than does any of the other subgroups 
under investigation. 
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ERRATUM 


In the article “Level of Aspiration and Academic Success” by Leonard Worrell 
(J. educ. Psychol., 1959, 55, 47-54) the following portion of Table 7 on page 52 


should read: 
As Scores 


<10 1l0and> 


rather than 
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EDUCATIONAL 
PSYCHOLOGY 


by 


George G. Thompson __ Eric F. Gardner 
Francis J. Di Vesta 


In this provocative new text is shown how the prin- 
ciples of psychology are applied to modern educational 
problems. While the basic facts of psychological research 
are adequately covered, the emphasis is on group ther- 
apy, dynamics, and personality adjustment of the child 
in school. The book covers both modern and traditional 
principles of learning and correlates them with numerous 
applications to classroom usage. It also discusses ways 
and means whereby teachers may have an important 
influence on the attitudes and accomplishments of their 
pupils. Systematic observations and measurement tech- 
niques are presented as valuable tools for evaluating the 
achievements, interests, adjustment, and psychological 
growth potential of the pupils. Numerous drawings, half- 
tones, and two-color charts are used according to a func- 
tional plan to illustrate concepts and principles in this 
lucidly written, teachable book. 535 pages, $6.00. 


Student's Workbook 


Following the organization, contents, and underlying philoso- 
phy of the text, the Workbook contains, for each chapter in 
the text, definitions, review exercises, essay questions, projects, 
and annotated outside texts to supplement the bibliography. 


138 pages, $1.90. 


Appleton-Century-Crofts, Inc. 
35 W. 32nd St., New York 1, N.Y. 
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GRADUATE 
EDUCATION 
IN 
PSYCHOLOGY 


Report of the Conference on Graduate Education in 
Psychology, sponsored by the Education and Training 
Board of the American Psychological Association and 
supported by a grant from the National Institute of 
Mental Health, U. S. Public Health Service; held at 
Miami Beach, Florida, November 29 to December 7, 
1958. 


Prepared by the Editorial Committee: 
Anne Roe, Chairman, 
and 
John W. Gustad, Bruce V. Moore, 
Sherman Ross, and Marie Skodak 


Price $1.50 
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LOOKING FOR A BOOK PUBLISHER? 


Book publication is one of the foundation stones of a pro- 
fessional career. To gain recognition, prestige, and advancement, it is often the 
means to an end. 


Exposition Press offers a complete publishing service under 
our special academic imprint, Exposition-University Books. Many of our recent titles in the 
academic fields have gained popular reviews, professional recognition and steady sales. 
These books are the result of a publishing plan that is bringing a continuous flow of emi- 
nent writers to Exposition Press. They reflect the high editorial standards and quality of 
design and production which have won the respect of libraries, schools, booksellers and 
critics. 


illustrated brochures, containing a detailed description of our 40% royalty- 
subsidy plan including a breakdown of contract terms and typical costs (in print for the 
first time). Copies are available on request. Your inquiries and manuscripts are invited. 
An editorial appraisal and sales evaluation will be furnished promptly without obligation. 


Write Ely Pennington, Editorial Department, 
EXPOSITION PRESS, Main Office, 386 Park Ave. S.,New York 16, N.Y. 
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This new text successfully relates 
the major theories of educational psychology 
to the daily activities of the teacher 


PSYCHOLOGY 
IN 
TEACHING AND LEARNING 


CiarK Trow, University of Michigan 


Each chapter of this concise and realistic new book 
introduces an educational situation and the psychologi- 
cal theories and facts needed to understand and handle 
it. These situations are deliberately arranged in the 
order in which the teacher will probably meet them— 
beginning with the class as an audience, moving through 
the discovery of individual differences to the problems 
of learning and of the manipulation of group processes. 
This arrangement enables the student to progress from 
the larger or molar patterns of behavior to the smaller 
or molecular patterns requiring more detailed analysis. 


In order to encourage the student to make full use 
of the rich supply of historical, theoretical, experi- 
mental and other related sources now available, Dr. 
Trow has kept his book purposely compact. Through- 
out PsycHoLoGcy 1n TEACHING AND LEARNING he pro- 
vides generous lists of outside readings which the 
instructor may adapt to individual student interests 
and abilities. A large number of half-tones and line 
drawings clarify and supplement the text. Additional 
help for the student is provided in the glossary which 
he may use to identify and understand important con- 
cepts. Both a Student’s Manual and an Instructor’s 
Manual will be available. 


approximately 400 pages Spring 1960 


PsycHOLOGY IN TEACHING AND LEARNING is under the 
editorship of Leonard Carmichael, The Smithsonian 
Institution. 


HOUGHTON MIFFLIN COMPANY - Boston 


New York 16 Atlanta 5 Geneva 
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